-- Logs begin at Mon 2022-04-11 23:18:07 UTC, end at Tue 2022-04-12 00:51:08 UTC. -- Apr 12 00:16:47.892047 dv-cinder-836252-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 12 00:16:47.901112 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 12 00:16:47.903135 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 12 00:16:47 2022] *** Apr 12 00:16:47.903135 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 12 00:16:47.903135 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 12 00:16:47.903135 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: nodename: dv-cinder-836252-3-iscsi Apr 12 00:16:47.903135 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: machine: x86_64 Apr 12 00:16:47.903135 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: clock source: unix Apr 12 00:16:47.903135 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: pcre jit disabled Apr 12 00:16:47.903135 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: detected number of CPU cores: 4 Apr 12 00:16:47.903135 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: current working directory: / Apr 12 00:16:47.903135 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: detected binary path: /usr/bin/uwsgi-core Apr 12 00:16:47.903837 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: your processes number limit is 47680 Apr 12 00:16:47.903837 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: your memory page size is 4096 bytes Apr 12 00:16:47.903837 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: detected max file descriptor number: 2048 Apr 12 00:16:47.903837 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: lock engine: pthread robust mutexes Apr 12 00:16:47.903837 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: thunder lock: enabled Apr 12 00:16:47.903837 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 12 00:16:47.903837 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 12 00:16:47.948275 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: Python main interpreter initialized at 0x5577c2a309c0 Apr 12 00:16:47.948275 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: python threads support enabled Apr 12 00:16:47.948275 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: your server socket listen backlog is limited to 100 connections Apr 12 00:16:47.948275 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: your mercy for graceful operations on workers is 90 seconds Apr 12 00:16:47.948611 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: mapped 403077 bytes (393 KB) for 2 cores Apr 12 00:16:47.948686 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: *** Operational MODE: preforking *** Apr 12 00:16:47.948930 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: *** uWSGI is running in multiple interpreter mode *** Apr 12 00:16:47.948930 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: spawned uWSGI master process (pid: 114120) Apr 12 00:16:47.949114 dv-cinder-836252-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 12 00:16:47.954276 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: spawned uWSGI worker 1 (pid: 114121, cores: 1) Apr 12 00:16:47.954276 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: spawned uWSGI worker 2 (pid: 114122, cores: 1) Apr 12 00:16:47.954276 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 00:16:49.126437 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 00:16:49.135503 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 00:16:49.978911 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 00:16:49.978911 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: from cryptography.utils import int_from_bytes Apr 12 00:16:49.979243 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 00:16:49.979243 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: from cryptography.utils import int_from_bytes Apr 12 00:16:49.980264 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 00:16:49.980264 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: from cryptography.utils import int_from_bytes Apr 12 00:16:49.980593 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 00:16:49.980593 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: from cryptography.utils import int_from_bytes Apr 12 00:16:52.491836 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 00:16:52.492407 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 00:16:52.492600 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 00:16:52.492960 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 00:16:52.493215 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 00:16:52.493539 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 00:16:52.493892 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.493975 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 00:16:52.494062 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.494220 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.494351 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 00:16:52.494578 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.494698 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 00:16:52.494912 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.495006 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 00:16:52.495226 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.495314 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.495548 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.495641 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.495867 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.495969 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.496195 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.496282 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.496459 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.496587 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.496773 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.496882 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.497100 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836252-3-iscsi {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.497204 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.497420 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.497511 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.497728 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.497827 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.498038 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.498125 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.498377 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.498467 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.498679 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.498783 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836252-3-iscsi {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.498999 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.499087 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.499309 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.499396 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.499618 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.499803 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.499945 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.500246 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.500346 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.500548 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.500642 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.501401 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.501496 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.501740 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.501938 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.502049 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.502274 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.502386 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.502599 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.502706 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.502914 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.503021 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.503253 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.503336 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.503574 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.503676 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.503884 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.503972 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836252-3-iscsi {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.504206 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.504341 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.504519 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.504614 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.504844 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.504985 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.505162 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.505262 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.505554 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836252-3-iscsi {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.505642 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.505861 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.505969 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.506171 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.506285 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.506536 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.506657 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.506830 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.506930 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.507156 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.507263 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.507479 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.507585 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.507795 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.507889 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.508111 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.508205 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.508415 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.508514 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.508723 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.508813 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.509030 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.509120 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.509348 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.509521 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.509670 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.509755 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.509946 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.510044 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.510190 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.510302 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.510525 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.510615 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.510845 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.510935 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.511164 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.511262 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.511479 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.511577 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.511720 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.511844 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.511996 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.512199 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.512297 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.512366 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.512592 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.512692 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.512899 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.512997 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.513195 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.513294 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.513449 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.513555 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.513770 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.513871 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.514074 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.514169 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.514403 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.514493 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.514712 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.514806 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.515018 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.515112 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.515333 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.515428 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.515640 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.515732 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.515949 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.516045 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.516251 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.516385 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.517133 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.517233 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.517487 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.517631 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.517772 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.517865 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.518081 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.518174 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.518440 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.518544 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.518759 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.518845 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.519070 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.519265 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.519385 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.519527 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.519703 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.519839 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.520008 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.520183 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.520314 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.520510 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.520633 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.520825 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.520917 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.521149 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.521253 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.521475 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.521566 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.521768 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.521864 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.522075 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.522175 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.522405 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.522497 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.522723 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.522814 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.523028 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.523128 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.523332 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.523430 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.523583 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.523671 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.523887 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.523986 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.524194 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.524291 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.524504 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.524602 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.524809 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.524899 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.525112 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.525208 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.525413 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.525502 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.525716 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.525804 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.526018 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.526107 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.526345 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.526436 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.526649 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.526739 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.526953 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.527048 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.527260 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.527413 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.527559 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.527778 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.527930 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.528065 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.528199 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.528342 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.528486 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.528621 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.528763 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.528897 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.529038 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.529174 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.529316 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.529451 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.529614 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.529766 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.529909 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.530053 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.530209 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.530397 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.530534 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.530669 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.530843 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.530986 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.531129 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.531270 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.531450 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.531607 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.531743 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.531955 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.532092 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.532226 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.532365 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.532509 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.532929 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.533080 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.533236 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.533377 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.533539 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.533681 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.533833 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.533982 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.534118 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.534290 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.534442 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.534579 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.534737 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.534888 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.535024 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.535159 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.535326 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.535467 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.535640 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.535793 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.535956 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.536097 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.536257 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.536403 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.536548 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.536681 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.536849 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.536991 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.537151 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.537292 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.537469 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.537611 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.537778 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.537990 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.538131 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.538303 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.538457 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.538600 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.538735 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.538869 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.539011 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:16:52.539154 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.539328 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.539476 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.539666 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.539808 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.539985 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.540137 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.540310 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.540451 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.540623 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.540774 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.540936 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.541087 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.541249 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.541397 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.541568 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.541719 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.541885 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.542026 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.542213 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.542380 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.542553 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.542692 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.542870 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.543031 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.543176 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.543311 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.543483 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.543634 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.543799 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.543950 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.544127 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.544275 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.544446 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.544617 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.544771 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.544905 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.545078 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.545218 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.545401 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.545544 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.545699 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.545833 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.546027 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.546178 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.546374 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.546529 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.546679 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.546816 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.546986 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.547128 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.547297 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.547446 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.547642 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.547796 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.548039 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.548197 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.548334 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.548478 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.548614 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.548757 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.548892 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.549033 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.549174 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.549319 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.549461 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.549607 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.549768 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.549910 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.550076 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.550227 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.550461 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.550603 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.550740 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.550875 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.551020 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.551169 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.552251 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.552399 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.552587 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.552723 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.552873 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.553010 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.553145 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.553278 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.553421 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.553563 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.553713 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.553854 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.553989 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.554123 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.554309 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.554472 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.554617 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.554761 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.554896 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.555031 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.555165 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.555305 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.555520 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.555658 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.555791 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.555926 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.556070 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.556207 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.556359 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.556496 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.556631 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.556765 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.556899 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.557048 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.557184 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.557319 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.557459 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.557595 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.557729 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.557871 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.558006 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.558240 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.558407 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.558543 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.558676 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.558823 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.558959 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.559093 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.559235 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.559378 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.559514 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.559659 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.559795 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.559940 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.560075 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.560210 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.560353 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.560490 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.560623 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.560765 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.560900 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.561034 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.561178 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.561314 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.561449 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.561584 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.561735 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.561872 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.562015 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.562152 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.562327 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.562468 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.562613 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.562750 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.562893 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.563029 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.563668 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.563821 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.563965 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.564126 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.564270 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.564415 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.564559 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.564695 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.564830 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.564973 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.565116 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.565251 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.565386 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.565521 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.565656 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.565814 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.565957 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.565957 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.566221 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.566381 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.566518 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.566664 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.566800 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.566934 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.567069 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.567203 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.567346 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.567481 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.567627 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.567768 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.567903 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.568038 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.568180 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.568398 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.568540 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.568676 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.568810 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.568951 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.569100 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.569236 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.569380 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.569526 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.569661 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.569795 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.569938 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.570081 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.570217 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.570375 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.570521 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.570671 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.570813 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.570948 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.571082 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.571259 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.571409 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.571554 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.571687 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.571863 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.572003 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.572172 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.572321 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.572487 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.572629 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.572807 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.572951 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.573117 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.573266 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.573427 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.573563 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.573727 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.573876 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.574039 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.574187 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.574360 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.574495 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.574674 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.574815 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.574979 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.575133 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.575280 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.575413 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.575597 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.575739 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.575918 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.576074 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.576236 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.576375 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.576547 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.576687 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.576853 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.577007 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.577165 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.577328 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.577464 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.577604 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.577761 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.577912 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.578056 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.578198 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.578397 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.578600 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.578749 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.579471 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.579615 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.579751 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.579896 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.580031 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.580180 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.580322 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.580459 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.580593 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.580727 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.580886 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.581038 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.581202 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.581344 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.581524 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.581666 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.581839 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.581990 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.582161 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.582364 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.582514 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.582657 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.582806 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.582942 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.583114 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.583265 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.583435 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.583576 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.583783 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.583933 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.584068 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.584211 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.584350 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.584483 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.584626 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.584769 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.584905 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.585046 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.585218 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.585362 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.585532 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.585685 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.585826 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.585963 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.586132 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.586316 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.586483 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.586625 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.586794 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.586936 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.587096 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.587246 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.587390 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.587527 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.587675 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.587816 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.588000 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.588150 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.588310 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.588450 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.588604 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.588808 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.588948 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.589092 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.589227 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.589361 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.589495 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.589642 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.589789 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.589925 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.590100 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.590315 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.590459 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.590594 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.590744 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.590881 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.591015 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.591149 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.591334 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.591476 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.591629 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.591773 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.591933 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.592075 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.592255 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.592397 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.592564 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.592713 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.592885 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.593020 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.593154 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.593287 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.593459 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.593619 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.593757 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.593890 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.594068 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.594220 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.594437 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.594588 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.594747 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.594890 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.595057 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.595209 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.595367 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.595520 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.595677 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.595826 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.595969 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.596120 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.596293 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.596466 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.596890 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.597041 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.597183 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.597334 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.597476 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.597617 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.597773 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.597921 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.598077 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.598220 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.598392 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.598533 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.598533 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.598853 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.599075 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.599224 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.599365 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.599512 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.599654 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.599819 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.599971 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.600115 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.600264 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.600406 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.600547 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.600714 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.600858 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.600999 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.601140 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.601282 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.601432 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.601593 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.601735 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.601886 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.602035 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.602179 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.602370 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.602469 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.602680 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.602818 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.602990 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.603090 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.603300 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.603390 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.603609 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.603700 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.603922 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.604021 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.604230 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.604321 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.604535 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.604711 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.604840 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.604930 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.605145 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.605231 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.605451 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.605549 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.605753 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.605839 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.606062 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.606148 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.606393 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.606499 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.606703 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.606798 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.607011 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.607097 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.607316 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.607481 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.607620 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.607715 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.607924 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.608012 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.608231 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.608383 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.608548 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.608636 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.608860 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.608955 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.609188 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.609277 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.609503 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.609632 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.609812 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.609906 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.610139 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.610225 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.610492 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.610581 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.610800 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.610896 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.611104 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.611191 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.611410 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.611497 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.611720 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.611815 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.612027 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.612121 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.612337 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.612423 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.612647 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.612746 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.612956 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.613053 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.613263 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.613350 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.613570 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.613667 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.613871 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.613958 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.614178 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.614294 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.614509 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.614599 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.614816 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.614900 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.615121 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.615214 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.615424 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.615512 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.615727 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.615815 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.616036 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.616122 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.616340 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.616434 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.616642 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.616728 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.616947 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.617032 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.617246 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.617333 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.617563 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.617655 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.617864 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.617959 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.618168 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.618281 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.618496 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.618590 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.618805 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.618902 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.619110 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.619203 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.619410 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.619495 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.619717 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.619810 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.620023 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.620117 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.620327 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.620421 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.620630 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.620752 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.620936 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.621025 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.621238 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.621324 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.621540 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.621629 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.621846 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.621931 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.622165 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.622270 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.622522 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.622610 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.622825 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.622918 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.623132 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.623217 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.623432 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.623519 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.623735 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.623821 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.624039 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.624123 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.624344 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.624441 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.624646 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.624733 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.624947 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.625042 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.625249 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.625392 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.625553 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.625649 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.626410 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.626520 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.626737 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.626824 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.627042 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.627127 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.627345 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.627440 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.627649 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.627744 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.627952 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.628044 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.628257 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.628353 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.628565 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.628652 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.628874 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.628967 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.629200 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.629289 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.629511 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.629599 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.629817 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.629904 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.630123 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.630211 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.630458 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.630546 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.630768 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.630863 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.631073 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.631161 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.631388 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.631474 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.631697 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.631783 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.632009 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.632097 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.632312 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.632399 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.632614 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.632707 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.632941 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.633028 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.633250 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.633336 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.633556 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.633650 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.633875 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.633962 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.634190 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.634323 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.634535 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.634635 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.634837 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.634924 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.635142 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.635228 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.635449 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.635543 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.635758 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.635853 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.636066 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.636153 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.636373 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.636536 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.636683 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.636773 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.636993 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.637087 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.637301 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.637397 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.637611 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.637696 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.637918 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.638010 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.638223 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.638373 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.638555 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.638690 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.638865 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.638953 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.639170 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.639265 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.639484 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.639576 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.639791 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.639877 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.640095 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.640183 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.640403 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.640489 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.640705 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.640799 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.641015 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.641101 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.641397 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.641990 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.642223 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.642362 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.642580 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.642668 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.642899 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.642993 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.643202 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.643301 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.643513 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.643600 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.643819 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.643905 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.644131 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.644227 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.644439 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.644531 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.644743 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.644868 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.645173 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.645262 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.645486 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.645578 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.645793 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.645879 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.646102 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.646189 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.646431 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.646531 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.646739 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.646826 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.647047 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.647142 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.647378 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.647465 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.647682 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.647831 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.647986 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.648148 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.648287 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.648464 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.648605 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.648780 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.648909 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.649088 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.649228 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.649398 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.649640 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.649740 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.649950 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.650037 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.650344 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.650450 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.650638 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.650738 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.650947 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.651034 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.651275 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.651361 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.651584 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.651680 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.651902 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.651989 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.652226 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.652313 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.652530 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.652622 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.652851 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.652938 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.653161 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.653314 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.653485 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.653630 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.654199 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.654387 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.654509 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.654627 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.654735 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.654841 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.654958 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.655081 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.655196 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.655304 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.655409 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.655528 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.655645 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.655800 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.655971 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.656132 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.656396 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.656510 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.656719 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.656835 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.657055 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.657180 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.657379 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.657503 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.657956 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.658073 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.658275 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.658394 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.658589 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.658719 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.658899 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.659015 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.659202 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.659322 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.659505 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.659656 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.659828 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.659971 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.660133 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.660297 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.660443 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.660626 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.660752 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.660938 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.661059 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.661249 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.661345 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.661564 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.661655 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.661873 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.661961 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.662183 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.662349 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.662540 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.662626 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.662852 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.662930 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.663169 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.663254 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.663483 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.663582 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.663785 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.663861 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.664090 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.664174 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.664398 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.664475 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.664698 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.664774 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.665003 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.665080 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.665307 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.665383 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.665632 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.665706 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.665937 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.666014 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.666270 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.666350 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.666586 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.666673 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.666921 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.667001 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.667229 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.667316 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.667534 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.667619 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.667841 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.667919 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.668150 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.668246 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.668476 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.668565 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.668791 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.668877 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.669094 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.669179 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.669401 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.669510 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.669709 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.669838 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.670013 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.670100 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.670340 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.670433 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.670648 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.670735 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.670956 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.671042 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.671259 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.671349 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.671560 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.671647 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.671862 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.671957 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.672180 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.672274 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.672483 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.672625 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.672848 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.672944 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.673161 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.673249 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.673468 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.673554 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.673773 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.673868 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.674078 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.674164 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.674409 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.674501 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.674717 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.674819 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.675042 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.675137 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.675353 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.675441 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.675671 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.675758 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.675982 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.676075 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.676290 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.676378 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.676597 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.676688 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.676910 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.677007 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.677223 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.677311 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.677541 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.677631 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.677854 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.677955 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.678169 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.678276 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.678514 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.678604 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.678828 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.678924 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.679139 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.679235 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.679474 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.679576 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.679765 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.679861 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.680081 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.680180 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.680403 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.680611 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.680722 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.680939 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.681027 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.681255 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.681345 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.681571 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.681666 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.681885 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.681974 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.682199 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.682308 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.682541 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.682631 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.682863 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.682964 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.683175 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.683406 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.683493 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.683741 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.683828 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.684063 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.684160 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.684383 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.684473 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.684701 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.684795 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.685019 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.685108 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.685330 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.685417 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.685643 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.685738 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.685953 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.686040 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.686279 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.686381 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.686599 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.686699 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.686935 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.687023 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.687242 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.687330 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.687556 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.687647 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.687870 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.687958 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.688710 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.688809 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.689030 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.689119 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.689341 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.689428 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.689657 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.689765 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.689967 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.690104 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.690299 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.690391 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.690613 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.690717 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.690926 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.691020 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.691238 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.691326 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.691560 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.691663 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.691871 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.691964 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.692183 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.692270 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.692496 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.692598 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.692808 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.692956 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.693121 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.693219 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.693429 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.693644 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.693731 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.693961 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.694057 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.694317 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.694424 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.694644 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.694733 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.694968 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.695063 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.695284 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.695381 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.695602 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.695690 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.695925 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.696012 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.696229 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.696451 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.696541 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.696772 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.696859 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.697111 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.697207 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.697413 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.697499 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.697734 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.697821 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.698043 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.698138 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.698371 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.698461 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.698691 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.698779 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.698998 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.699099 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.699312 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.699530 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.699618 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.699879 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.700163 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.700262 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.700346 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.700503 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.700601 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.700820 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.700915 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.701127 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.701215 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.701431 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.701517 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.701750 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.701850 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.702053 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.702310 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.702405 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.702661 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.702749 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.702981 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.703071 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.703280 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.703366 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.703586 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.703687 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.704483 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.704579 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.704796 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.704885 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.705103 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.705204 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.705412 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.705500 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.705715 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.705809 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.706041 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.706136 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.706368 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.706458 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.706676 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.706763 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.706981 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.707086 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.707292 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.707383 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.707594 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.707682 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.707902 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.708001 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.708203 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.708290 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.708507 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.708595 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.708817 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.708907 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.709123 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.709211 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.709429 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.709526 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.709730 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.709885 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.710044 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.710176 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.710378 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.710469 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.710687 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.710780 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.711030 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.711120 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.711339 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.711440 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.711640 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.711731 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.711944 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.712044 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.712255 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.712354 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.712560 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.712651 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.712871 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.712962 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.713181 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.713281 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.713485 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.713576 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.713826 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.713926 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.714140 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.714241 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.714475 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.714702 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.714794 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.715045 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.715222 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.715374 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.715461 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.715701 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.715792 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.716015 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.716115 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.716328 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.716428 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.716635 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.716726 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.716946 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.717046 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.717270 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.717512 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.717605 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.717852 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.717945 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.718175 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.718289 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.718512 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.718602 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.718823 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.718930 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.719132 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.719233 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.719464 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.719559 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.719778 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.719904 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.720090 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.720181 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.720398 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.720491 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.722271 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.722429 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.722542 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.722649 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.722757 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.722864 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.722979 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.723087 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.723193 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.723310 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.723426 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.723534 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.723648 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.723768 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.723875 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.723987 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.724094 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.724199 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.724325 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.724491 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.724605 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.724711 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.724848 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.724943 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.725026 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.725110 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.725199 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.725292 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.725374 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.725512 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.725602 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.725690 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.725771 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.725853 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.725939 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.726033 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.726274 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.726367 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.726590 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.726680 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.726896 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.726996 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.727212 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.727316 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.727535 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.727635 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.727842 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.727933 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.728153 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.728240 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.728460 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.728573 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.728787 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.728877 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.729122 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.729210 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.729450 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.729545 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.729774 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.729863 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.730082 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.730208 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.730409 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.730533 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.730716 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.730817 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.731020 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.731110 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.731335 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.731434 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.731641 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.731729 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.731944 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.732039 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.732246 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.732343 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.732551 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.732640 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.732858 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.732955 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.733161 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.733259 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.733464 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.733552 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.733767 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.733856 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.734075 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.734165 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.734401 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.734493 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.734705 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.734804 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.735007 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.735624 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.735835 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.735924 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.736140 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.736228 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.736445 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.736542 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.736750 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.736844 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.737050 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.737150 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.737353 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.737442 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.737660 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.737758 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.737956 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.738052 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.738271 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.738364 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.738585 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.738672 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.738893 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.738991 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.739200 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.739295 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.739512 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.739600 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.739820 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.739916 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.740130 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.740242 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.740440 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.740541 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.740800 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.740910 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.741052 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.741141 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.741367 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.741456 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.741677 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.741769 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.742053 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.742149 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.742347 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.742442 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.742660 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.742752 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.742978 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.743066 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.743286 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.743372 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.743592 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.743688 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.743902 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.744002 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.744225 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.744390 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.744537 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.744627 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.744840 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.744934 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.745165 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.745269 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.745476 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.745563 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.745789 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.745878 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.746101 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.746203 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.746443 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.746547 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.746753 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.746843 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.747071 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.747160 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.747381 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.747470 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.747698 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.747798 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.748007 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.748110 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.748318 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.748412 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.748633 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.748736 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.748946 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.749046 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.749257 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.749348 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.749584 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.749683 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.749896 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.749987 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.750210 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.750325 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.750557 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.750683 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.751438 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.751524 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.751770 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.751862 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.752094 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.752195 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.752406 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.752497 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.752715 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.752806 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.753025 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.753118 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.753288 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 00:16:52.753377 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.753680 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.754029 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.754372 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.754724 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.755058 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.755379 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.755695 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.756005 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:16:52.756251 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 00:16:52.775893 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_db.sqlalchemy.engines [None req-3c354c08-d440-4f0a-a2d0-543de3b2dbcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:16:52.778322 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG oslo_db.sqlalchemy.engines [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:16:52.838704 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.context [None req-3c354c08-d440-4f0a-a2d0-543de3b2dbcc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5ead109-62c7-446f-b4c2-717e64dca700(cell1) {{(pid=114122) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 00:16:52.840309 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.context [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5ead109-62c7-446f-b4c2-717e64dca700(cell1) {{(pid=114121) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 00:16:52.844484 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-3c354c08-d440-4f0a-a2d0-543de3b2dbcc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:16:52.846016 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG oslo_concurrency.lockutils [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:16:52.846143 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-3c354c08-d440-4f0a-a2d0-543de3b2dbcc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:16:52.846904 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-3c354c08-d440-4f0a-a2d0-543de3b2dbcc None None] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:16:52.847697 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG oslo_concurrency.lockutils [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:16:52.848492 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG oslo_concurrency.lockutils [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:16:52.848832 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-3c354c08-d440-4f0a-a2d0-543de3b2dbcc None None] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:16:52.850466 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG oslo_concurrency.lockutils [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:16:52.859445 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_db.sqlalchemy.engines [None req-3c354c08-d440-4f0a-a2d0-543de3b2dbcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:16:52.863376 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG oslo_db.sqlalchemy.engines [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:16:52.868576 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_db.sqlalchemy.engines [None req-3c354c08-d440-4f0a-a2d0-543de3b2dbcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:16:52.871250 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG oslo_db.sqlalchemy.engines [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:16:53.023626 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_db.sqlalchemy.engines [None req-3c354c08-d440-4f0a-a2d0-543de3b2dbcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:16:53.024876 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG oslo_db.sqlalchemy.engines [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:16:53.476461 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: WARNING keystonemiddleware.auth_token [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 00:16:53.478032 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: WARNING keystonemiddleware.auth_token [None req-3c354c08-d440-4f0a-a2d0-543de3b2dbcc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 00:16:53.483037 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: WARNING keystonemiddleware.auth_token [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 00:16:53.484627 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: WARNING keystonemiddleware.auth_token [None req-3c354c08-d440-4f0a-a2d0-543de3b2dbcc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 00:16:53.702037 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: WARNING keystonemiddleware.auth_token [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 00:16:53.707332 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: WARNING keystonemiddleware.auth_token [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 00:16:53.709348 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: WARNING keystonemiddleware.auth_token [None req-3c354c08-d440-4f0a-a2d0-543de3b2dbcc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 00:16:53.712618 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5577c2a309c0 pid: 114121 (default app) Apr 12 00:16:53.714681 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:16:53.714804 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: WARNING keystonemiddleware.auth_token [None req-3c354c08-d440-4f0a-a2d0-543de3b2dbcc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 00:16:53.715851 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] 10.222.0.32 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001722 Apr 12 00:16:53.716256 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 788 bytes} [Tue Apr 12 00:16:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:16:53.719889 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5577c2a309c0 pid: 114122 (default app) Apr 12 00:18:12.052977 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:18:12.054026 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Apr 12 00:18:12.058604 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 2/2] 10.222.0.32 () {54 vars in 930 bytes} [Tue Apr 12 00:18:12 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:18:12.475897 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-cb6436d1-28c4-4163-abde-6fafd5433026 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:18:12.504486 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-cb6436d1-28c4-4163-abde-6fafd5433026 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.442030 Apr 12 00:18:12.505127 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 1/3] 10.222.0.32 () {60 vars in 1291 bytes} [Tue Apr 12 00:18:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:18:14.845239 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:18:14.846165 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-6d8a008f-836a-412a-99ca-f3e6b3e5867f None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001389 Apr 12 00:18:14.846817 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 3/4] 10.222.0.32 () {54 vars in 930 bytes} [Tue Apr 12 00:18:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:18:14.908261 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-b3380815-1058-4b92-a49d-b9ae08fbf3c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:14.927430 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:18:14.927430 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: warnings.warn(msg) Apr 12 00:18:14.954430 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-b3380815-1058-4b92-a49d-b9ae08fbf3c7 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.101707 Apr 12 00:18:14.961983 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 2/5] 10.222.0.32 () {64 vars in 1282 bytes} [Tue Apr 12 00:18:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:18:15.182761 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-ebbed1f4-187d-44bd-b749-a3ee275b312a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:15.185352 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:18:15.185352 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: warnings.warn(msg) Apr 12 00:18:15.233852 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-ebbed1f4-187d-44bd-b749-a3ee275b312a admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.269646 Apr 12 00:18:15.234867 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 4/6] 10.222.0.32 () {64 vars in 1335 bytes} [Tue Apr 12 00:18:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:18:17.576554 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-b3380815-1058-4b92-a49d-b9ae08fbf3c7 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:18:17.578139 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-b3380815-1058-4b92-a49d-b9ae08fbf3c7 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002015 Apr 12 00:18:17.578580 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 3/7] 10.222.0.32 () {54 vars in 930 bytes} [Tue Apr 12 00:18:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:18:17.692070 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-3695222f-7187-4858-8ead-2e6564818020 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "rxtx_factor": 1.0, "swap": 0, "disk": 5, "ram": 512}} {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:17.712898 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:18:17.712898 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: warnings.warn(msg) Apr 12 00:18:17.734739 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-3695222f-7187-4858-8ead-2e6564818020 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150156 Apr 12 00:18:17.735218 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 5/8] 10.222.0.32 () {64 vars in 1282 bytes} [Tue Apr 12 00:18:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:18:17.746968 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-14bac0b5-4929-485b-ba6f-e17469a8dc33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:17.748743 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:18:17.748743 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: warnings.warn(msg) Apr 12 00:18:17.783703 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-14bac0b5-4929-485b-ba6f-e17469a8dc33 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040318 Apr 12 00:18:17.784402 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 4/9] 10.222.0.32 () {64 vars in 1335 bytes} [Tue Apr 12 00:18:17 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:18:20.134401 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-3695222f-7187-4858-8ead-2e6564818020 admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:18:20.135581 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-3695222f-7187-4858-8ead-2e6564818020 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001831 Apr 12 00:18:20.136078 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 6/10] 10.222.0.32 () {54 vars in 930 bytes} [Tue Apr 12 00:18:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:18:20.196307 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-ad05b2f7-0011-4230-965e-34e7fe5709ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "rxtx_factor": 1.0, "swap": 0, "name": "ds1G", "disk": 10, "vcpus": 1, "id": "d2"}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:20.216582 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-ad05b2f7-0011-4230-965e-34e7fe5709ee admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074015 Apr 12 00:18:20.217398 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 5/11] 10.222.0.32 () {64 vars in 1282 bytes} [Tue Apr 12 00:18:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:18:20.228968 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-e024999c-e618-4a97-bbf6-f9f039c36d40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:20.259209 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-e024999c-e618-4a97-bbf6-f9f039c36d40 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033755 Apr 12 00:18:20.259787 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 7/12] 10.222.0.32 () {64 vars in 1335 bytes} [Tue Apr 12 00:18:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:18:22.629468 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-ad05b2f7-0011-4230-965e-34e7fe5709ee admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:18:22.630614 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-ad05b2f7-0011-4230-965e-34e7fe5709ee admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Apr 12 00:18:22.631140 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 6/13] 10.222.0.32 () {54 vars in 930 bytes} [Tue Apr 12 00:18:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:18:22.692930 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-b867f341-9f03-471f-aeb9-cd1d11bc76c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "id": "d3"}} {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:22.712087 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-b867f341-9f03-471f-aeb9-cd1d11bc76c1 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074613 Apr 12 00:18:22.712640 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 8/14] 10.222.0.32 () {64 vars in 1282 bytes} [Tue Apr 12 00:18:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 00:18:22.724802 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-79792ef5-5277-4bf5-be2b-4b3037530849 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:22.747325 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-79792ef5-5277-4bf5-be2b-4b3037530849 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026156 Apr 12 00:18:22.748104 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 7/15] 10.222.0.32 () {64 vars in 1335 bytes} [Tue Apr 12 00:18:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:18:25.107390 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-b867f341-9f03-471f-aeb9-cd1d11bc76c1 admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:18:25.108919 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-b867f341-9f03-471f-aeb9-cd1d11bc76c1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002054 Apr 12 00:18:25.109573 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 9/16] 10.222.0.32 () {54 vars in 930 bytes} [Tue Apr 12 00:18:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:18:25.166579 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-34867e86-d1a3-4efa-a371-3e562ed0ff20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "disk": 20}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:25.183823 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-34867e86-d1a3-4efa-a371-3e562ed0ff20 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068182 Apr 12 00:18:25.184520 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 8/17] 10.222.0.32 () {64 vars in 1282 bytes} [Tue Apr 12 00:18:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:18:25.196641 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-292078a3-b693-4fe5-b437-6f4df6a5fcb7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:25.217759 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-292078a3-b693-4fe5-b437-6f4df6a5fcb7 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024696 Apr 12 00:18:25.218508 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 10/18] 10.222.0.32 () {64 vars in 1335 bytes} [Tue Apr 12 00:18:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:18:27.533549 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-34867e86-d1a3-4efa-a371-3e562ed0ff20 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:18:27.535152 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-34867e86-d1a3-4efa-a371-3e562ed0ff20 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Apr 12 00:18:27.538560 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 9/19] 10.222.0.32 () {54 vars in 930 bytes} [Tue Apr 12 00:18:27 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:18:27.600938 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-8f601e41-bec6-4c73-8a2d-d7e6d84bdd8f admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:18:27.625053 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-8f601e41-bec6-4c73-8a2d-d7e6d84bdd8f admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081932 Apr 12 00:18:27.625756 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 11/20] 10.222.0.32 () {60 vars in 1291 bytes} [Tue Apr 12 00:18:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:18:30.008639 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-34867e86-d1a3-4efa-a371-3e562ed0ff20 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:18:30.009641 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-34867e86-d1a3-4efa-a371-3e562ed0ff20 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Apr 12 00:18:30.010046 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 10/21] 10.222.0.32 () {54 vars in 930 bytes} [Tue Apr 12 00:18:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:18:30.069447 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-82bb7a91-1381-4048-a0a5-aa5499dccefb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "os-flavor-access:is_public": true}} {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:30.088918 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-82bb7a91-1381-4048-a0a5-aa5499dccefb admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072070 Apr 12 00:18:30.089626 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 12/22] 10.222.0.32 () {64 vars in 1282 bytes} [Tue Apr 12 00:18:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:18:30.101249 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-c3c7a747-0018-40a5-ad38-73ecad6cb51f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:30.124070 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-c3c7a747-0018-40a5-ad38-73ecad6cb51f admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025880 Apr 12 00:18:30.124601 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 11/23] 10.222.0.32 () {64 vars in 1332 bytes} [Tue Apr 12 00:18:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:18:32.485932 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-82bb7a91-1381-4048-a0a5-aa5499dccefb admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:18:32.487392 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-82bb7a91-1381-4048-a0a5-aa5499dccefb admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002043 Apr 12 00:18:32.487993 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 13/24] 10.222.0.32 () {54 vars in 930 bytes} [Tue Apr 12 00:18:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:18:32.548367 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-9ca5cf70-2164-4021-8323-f11c39355b86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:32.569273 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-9ca5cf70-2164-4021-8323-f11c39355b86 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073725 Apr 12 00:18:32.570038 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 12/25] 10.222.0.32 () {64 vars in 1282 bytes} [Tue Apr 12 00:18:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 00:18:32.584458 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-b30360e6-9f98-4bc1-95cb-e346811bbf68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:32.611818 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-b30360e6-9f98-4bc1-95cb-e346811bbf68 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030995 Apr 12 00:18:32.612673 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 14/26] 10.222.0.32 () {64 vars in 1332 bytes} [Tue Apr 12 00:18:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:18:34.990999 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-9ca5cf70-2164-4021-8323-f11c39355b86 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:18:34.992071 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-9ca5cf70-2164-4021-8323-f11c39355b86 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Apr 12 00:18:34.992476 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 13/27] 10.222.0.32 () {54 vars in 930 bytes} [Tue Apr 12 00:18:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:18:35.050561 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-8b77f778-e380-455c-bf14-f2ec08b498ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "disk": 40, "name": "m1.medium"}} {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:35.068003 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-8b77f778-e380-455c-bf14-f2ec08b498ea admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069762 Apr 12 00:18:35.068639 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 15/28] 10.222.0.32 () {64 vars in 1282 bytes} [Tue Apr 12 00:18:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:18:35.080960 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-6e1ff375-818a-447d-879f-b7cea92c1971 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:35.102649 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-6e1ff375-818a-447d-879f-b7cea92c1971 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025969 Apr 12 00:18:35.103372 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 14/29] 10.222.0.32 () {64 vars in 1332 bytes} [Tue Apr 12 00:18:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:18:37.433991 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-8b77f778-e380-455c-bf14-f2ec08b498ea admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:18:37.435170 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-8b77f778-e380-455c-bf14-f2ec08b498ea admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Apr 12 00:18:37.435649 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 16/30] 10.222.0.32 () {54 vars in 930 bytes} [Tue Apr 12 00:18:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:18:37.495239 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-4adb54c2-0e90-4146-8f81-58bba548e0ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "ram": 8192, "disk": 80}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:37.515016 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-4adb54c2-0e90-4146-8f81-58bba548e0ad admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072297 Apr 12 00:18:37.515554 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 15/31] 10.222.0.32 () {64 vars in 1282 bytes} [Tue Apr 12 00:18:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 00:18:37.527306 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-cab241b3-99a9-4833-a621-8bdacc3cbb15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:37.551184 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-cab241b3-99a9-4833-a621-8bdacc3cbb15 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027585 Apr 12 00:18:37.551763 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 17/32] 10.222.0.32 () {64 vars in 1332 bytes} [Tue Apr 12 00:18:37 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:18:39.952386 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-4adb54c2-0e90-4146-8f81-58bba548e0ad admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:18:39.953613 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-4adb54c2-0e90-4146-8f81-58bba548e0ad admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Apr 12 00:18:39.954543 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 16/33] 10.222.0.32 () {54 vars in 930 bytes} [Tue Apr 12 00:18:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:18:40.016109 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-bd2ccdad-07ef-4412-bd90-7e8e8d3803c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "ram": 16384}} {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:40.038937 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-bd2ccdad-07ef-4412-bd90-7e8e8d3803c1 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078787 Apr 12 00:18:40.039491 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 18/34] 10.222.0.32 () {64 vars in 1282 bytes} [Tue Apr 12 00:18:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:18:40.051195 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-7b2922a8-0e44-47ca-8fe0-344e82f360f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:18:40.076053 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-7b2922a8-0e44-47ca-8fe0-344e82f360f2 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028315 Apr 12 00:18:40.077438 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 17/35] 10.222.0.32 () {64 vars in 1332 bytes} [Tue Apr 12 00:18:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:19:03.702938 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-bd2ccdad-07ef-4412-bd90-7e8e8d3803c1 admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:03.704018 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-bd2ccdad-07ef-4412-bd90-7e8e8d3803c1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Apr 12 00:19:03.704413 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 19/36] 10.222.0.32 () {54 vars in 930 bytes} [Tue Apr 12 00:19:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:19:03.759914 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-4b1ef1a8-7e70-47f3-beeb-89521d8fe165 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:03.776973 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-4b1ef1a8-7e70-47f3-beeb-89521d8fe165 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066715 Apr 12 00:19:03.777496 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 18/37] 10.222.0.32 () {60 vars in 1291 bytes} [Tue Apr 12 00:19:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:19:05.148033 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-bd2ccdad-07ef-4412-bd90-7e8e8d3803c1 admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:05.149061 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-bd2ccdad-07ef-4412-bd90-7e8e8d3803c1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Apr 12 00:19:05.149458 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 20/38] 10.222.0.32 () {56 vars in 1074 bytes} [Tue Apr 12 00:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:19:05.346388 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-21627142-41ba-4489-817d-ad8b2dbf54fa admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:05.351886 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.wsgi [None req-21627142-41ba-4489-817d-ad8b2dbf54fa admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 12 00:19:05.352446 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-21627142-41ba-4489-817d-ad8b2dbf54fa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:19:05.353225 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-21627142-41ba-4489-817d-ad8b2dbf54fa admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057439 Apr 12 00:19:05.353757 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 19/39] 10.222.0.32 () {60 vars in 1190 bytes} [Tue Apr 12 00:19:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:05.363065 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-01c1bfff-c692-4757-a9d2-739aa76ed822 admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:05.383140 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-01c1bfff-c692-4757-a9d2-739aa76ed822 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023718 Apr 12 00:19:05.383671 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 21/40] 10.222.0.32 () {60 vars in 1210 bytes} [Tue Apr 12 00:19:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:19:05.393205 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-afe2ad3c-fee5-406f-8339-308a37e4c4d9 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:05.414437 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-afe2ad3c-fee5-406f-8339-308a37e4c4d9 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024525 Apr 12 00:19:05.414963 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 20/41] 10.222.0.32 () {60 vars in 1210 bytes} [Tue Apr 12 00:19:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:19:05.423808 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-496c1b0c-9eb0-483a-89f4-f5c98de5f7d7 admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:05.429085 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.wsgi [None req-496c1b0c-9eb0-483a-89f4-f5c98de5f7d7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 12 00:19:05.429652 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-496c1b0c-9eb0-483a-89f4-f5c98de5f7d7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:19:05.430472 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-496c1b0c-9eb0-483a-89f4-f5c98de5f7d7 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010145 Apr 12 00:19:05.430969 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 22/42] 10.222.0.32 () {60 vars in 1190 bytes} [Tue Apr 12 00:19:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:06.666949 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-afe2ad3c-fee5-406f-8339-308a37e4c4d9 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:06.668360 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-afe2ad3c-fee5-406f-8339-308a37e4c4d9 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Apr 12 00:19:06.668360 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 21/43] 10.222.0.32 () {56 vars in 1074 bytes} [Tue Apr 12 00:19:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:19:06.854502 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-5eb50a48-fb18-4295-980d-faed2d861a0c admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:06.859746 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.wsgi [None req-5eb50a48-fb18-4295-980d-faed2d861a0c admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 12 00:19:06.860301 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-5eb50a48-fb18-4295-980d-faed2d861a0c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:19:06.861086 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-5eb50a48-fb18-4295-980d-faed2d861a0c admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057395 Apr 12 00:19:06.861589 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 23/44] 10.222.0.32 () {60 vars in 1190 bytes} [Tue Apr 12 00:19:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:06.870744 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-df95d544-db26-4d42-bba4-0d59ea239647 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:06.884255 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-df95d544-db26-4d42-bba4-0d59ea239647 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016952 Apr 12 00:19:06.884719 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 22/45] 10.222.0.32 () {60 vars in 1210 bytes} [Tue Apr 12 00:19:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:19:06.894298 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-07d8be3f-9f3b-4a2f-a813-28f11028fdc7 admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:06.908516 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-07d8be3f-9f3b-4a2f-a813-28f11028fdc7 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017673 Apr 12 00:19:06.909031 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 24/46] 10.222.0.32 () {60 vars in 1210 bytes} [Tue Apr 12 00:19:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:19:06.917792 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-a1b93a8c-93ee-447b-9841-aae2f7b4dba2 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:06.922854 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.wsgi [None req-a1b93a8c-93ee-447b-9841-aae2f7b4dba2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 12 00:19:06.923408 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-a1b93a8c-93ee-447b-9841-aae2f7b4dba2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:19:06.924168 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-a1b93a8c-93ee-447b-9841-aae2f7b4dba2 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009847 Apr 12 00:19:06.924646 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 23/47] 10.222.0.32 () {60 vars in 1190 bytes} [Tue Apr 12 00:19:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 12 00:19:08.181669 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-07d8be3f-9f3b-4a2f-a813-28f11028fdc7 admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:08.182693 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-07d8be3f-9f3b-4a2f-a813-28f11028fdc7 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Apr 12 00:19:08.183091 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 25/48] 10.222.0.32 () {56 vars in 1074 bytes} [Tue Apr 12 00:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:19:08.370975 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-24d8bdf0-33b5-4114-b670-2eba200ebff9 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:08.376211 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.wsgi [None req-24d8bdf0-33b5-4114-b670-2eba200ebff9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 12 00:19:08.376769 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-24d8bdf0-33b5-4114-b670-2eba200ebff9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:19:08.377550 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-24d8bdf0-33b5-4114-b670-2eba200ebff9 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057738 Apr 12 00:19:08.378052 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 24/49] 10.222.0.32 () {60 vars in 1193 bytes} [Tue Apr 12 00:19:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 12 00:19:08.387356 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-125723a9-7d41-418d-a39a-c60320bdb31a admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:08.401192 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-125723a9-7d41-418d-a39a-c60320bdb31a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017324 Apr 12 00:19:08.401652 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 26/50] 10.222.0.32 () {60 vars in 1210 bytes} [Tue Apr 12 00:19:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:19:08.411910 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-9417fe4b-e82c-47ab-ab05-356e3d4ecef0 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:08.424651 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-9417fe4b-e82c-47ab-ab05-356e3d4ecef0 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016521 Apr 12 00:19:08.425166 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 25/51] 10.222.0.32 () {60 vars in 1210 bytes} [Tue Apr 12 00:19:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:19:08.433802 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-e40262e0-725c-4b80-be9b-b9dac483a572 admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:08.438828 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.wsgi [None req-e40262e0-725c-4b80-be9b-b9dac483a572 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 12 00:19:08.439376 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-e40262e0-725c-4b80-be9b-b9dac483a572 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:19:08.440140 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-e40262e0-725c-4b80-be9b-b9dac483a572 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009735 Apr 12 00:19:08.440619 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 27/52] 10.222.0.32 () {60 vars in 1193 bytes} [Tue Apr 12 00:19:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:09.746845 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-9417fe4b-e82c-47ab-ab05-356e3d4ecef0 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:09.747913 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-9417fe4b-e82c-47ab-ab05-356e3d4ecef0 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Apr 12 00:19:09.748310 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 26/53] 10.222.0.32 () {56 vars in 1074 bytes} [Tue Apr 12 00:19:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:19:09.938013 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-abcb47f6-e943-412c-a8f3-60af90b53585 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:19:09.956795 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-abcb47f6-e943-412c-a8f3-60af90b53585 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071122 Apr 12 00:19:09.957332 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 28/54] 10.222.0.32 () {64 vars in 1235 bytes} [Tue Apr 12 00:19:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:19:11.240480 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-9417fe4b-e82c-47ab-ab05-356e3d4ecef0 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:11.241470 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-9417fe4b-e82c-47ab-ab05-356e3d4ecef0 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001394 Apr 12 00:19:11.241860 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 27/55] 10.222.0.32 () {56 vars in 1074 bytes} [Tue Apr 12 00:19:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:19:11.426168 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-ecfca013-c677-4afb-ba38-fe6918bccb41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:19:11.443412 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-ecfca013-c677-4afb-ba38-fe6918bccb41 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.066540 Apr 12 00:19:11.443949 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 29/56] 10.222.0.32 () {64 vars in 1235 bytes} [Tue Apr 12 00:19:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 00:19:12.843305 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-9417fe4b-e82c-47ab-ab05-356e3d4ecef0 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:12.844374 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-9417fe4b-e82c-47ab-ab05-356e3d4ecef0 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Apr 12 00:19:12.844752 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 28/57] 10.222.0.32 () {56 vars in 1074 bytes} [Tue Apr 12 00:19:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:19:13.034131 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-5359b056-d976-4d0d-8c69-00373bce6332 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:19:13.051775 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-5359b056-d976-4d0d-8c69-00373bce6332 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071565 Apr 12 00:19:13.052322 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 30/58] 10.222.0.32 () {64 vars in 1235 bytes} [Tue Apr 12 00:19:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:19:14.332051 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-9417fe4b-e82c-47ab-ab05-356e3d4ecef0 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:14.333051 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-9417fe4b-e82c-47ab-ab05-356e3d4ecef0 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Apr 12 00:19:14.333451 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 29/59] 10.222.0.32 () {56 vars in 1074 bytes} [Tue Apr 12 00:19:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:19:14.518986 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-dff2833d-7664-464a-badf-2acaf976ec01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:19:14.541060 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-dff2833d-7664-464a-badf-2acaf976ec01 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067943 Apr 12 00:19:14.541720 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 31/60] 10.222.0.32 () {64 vars in 1235 bytes} [Tue Apr 12 00:19:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:19:15.807378 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-9417fe4b-e82c-47ab-ab05-356e3d4ecef0 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:15.808366 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-9417fe4b-e82c-47ab-ab05-356e3d4ecef0 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Apr 12 00:19:15.808781 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 30/61] 10.222.0.32 () {56 vars in 1074 bytes} [Tue Apr 12 00:19:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:19:15.992995 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-af5c9144-77e4-4327-b295-1b135611078a admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:19:16.012541 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-af5c9144-77e4-4327-b295-1b135611078a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069714 Apr 12 00:19:16.013075 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 32/62] 10.222.0.32 () {60 vars in 1202 bytes} [Tue Apr 12 00:19:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:20:18.724131 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-9417fe4b-e82c-47ab-ab05-356e3d4ecef0 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:20:18.725134 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-9417fe4b-e82c-47ab-ab05-356e3d4ecef0 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Apr 12 00:20:18.725531 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 31/63] 10.222.0.32 () {54 vars in 930 bytes} [Tue Apr 12 00:20:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:20:18.781356 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-f12bc54d-4f95-4b7a-84cb-225049670965 admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:20:18.800475 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-f12bc54d-4f95-4b7a-84cb-225049670965 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069157 Apr 12 00:20:18.800995 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 33/64] 10.222.0.32 () {60 vars in 1291 bytes} [Tue Apr 12 00:20:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:20:18.823440 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-d35c8216-0424-4bef-bd4d-28fd5635c003 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:20:18.831037 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-d35c8216-0424-4bef-bd4d-28fd5635c003 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011905 Apr 12 00:20:18.831547 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 32/65] 10.222.0.32 () {60 vars in 1282 bytes} [Tue Apr 12 00:20:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:20:18.842392 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-13c89bd0-3e5e-4397-b986-a9242bdb600b admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:20:18.849610 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-13c89bd0-3e5e-4397-b986-a9242bdb600b admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010758 Apr 12 00:20:18.850115 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 34/66] 10.222.0.32 () {60 vars in 1285 bytes} [Tue Apr 12 00:20:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:20:18.861292 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-58491f80-1301-49bf-b7d9-11db2396cd96 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:20:18.868414 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-58491f80-1301-49bf-b7d9-11db2396cd96 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010541 Apr 12 00:20:18.868918 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 33/67] 10.222.0.32 () {60 vars in 1285 bytes} [Tue Apr 12 00:20:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:20:18.880447 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-3a60ddf5-7047-4cc9-bd95-4dbcd6ff72e5 admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:20:18.887944 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-3a60ddf5-7047-4cc9-bd95-4dbcd6ff72e5 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011062 Apr 12 00:20:18.888470 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 35/68] 10.222.0.32 () {60 vars in 1282 bytes} [Tue Apr 12 00:20:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:21:57.999396 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-5635f092-034e-4224-b2e7-d9e6d52d8ea9 tempest-verify_tempest_config-1534479741 tempest-verify_tempest_config-1534479741-project] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:21:58.001416 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-5635f092-034e-4224-b2e7-d9e6d52d8ea9 tempest-verify_tempest_config-1534479741 tempest-verify_tempest_config-1534479741-project] 10.222.0.32 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105600 Apr 12 00:21:58.001934 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 34/69] 10.222.0.32 () {58 vars in 1133 bytes} [Tue Apr 12 00:21:57 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:23:36.291067 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-3a60ddf5-7047-4cc9-bd95-4dbcd6ff72e5 admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:23:36.292060 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-3a60ddf5-7047-4cc9-bd95-4dbcd6ff72e5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Apr 12 00:23:36.292454 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 36/70] 10.222.0.32 () {56 vars in 1074 bytes} [Tue Apr 12 00:23:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:23:36.538744 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-c5b1b4cf-a142-493e-baff-3466ac308894 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:23:36.539902 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:23:36.539902 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: warnings.warn(msg) Apr 12 00:23:36.541073 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-c5b1b4cf-a142-493e-baff-3466ac308894 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:23:36.541502 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-c5b1b4cf-a142-493e-baff-3466ac308894 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:23:36.542293 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-c5b1b4cf-a142-493e-baff-3466ac308894 admin admin] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:23:36.542740 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-c5b1b4cf-a142-493e-baff-3466ac308894 admin admin] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:23:36.576644 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-c5b1b4cf-a142-493e-baff-3466ac308894 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.146490 Apr 12 00:23:36.577185 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 35/71] 10.222.0.32 () {60 vars in 1193 bytes} [Tue Apr 12 00:23:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:23:37.858803 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-3a60ddf5-7047-4cc9-bd95-4dbcd6ff72e5 admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:23:37.859795 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-3a60ddf5-7047-4cc9-bd95-4dbcd6ff72e5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Apr 12 00:23:37.860184 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 37/72] 10.222.0.32 () {56 vars in 1074 bytes} [Tue Apr 12 00:23:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:23:38.048459 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-a9e35278-0c06-4cdd-9012-ec84550d6faa admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:23:38.049646 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:23:38.049646 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: warnings.warn(msg) Apr 12 00:23:38.050839 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-a9e35278-0c06-4cdd-9012-ec84550d6faa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:23:38.051279 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-a9e35278-0c06-4cdd-9012-ec84550d6faa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:23:38.052055 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-a9e35278-0c06-4cdd-9012-ec84550d6faa admin admin] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:23:38.052476 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-a9e35278-0c06-4cdd-9012-ec84550d6faa admin admin] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:23:38.070955 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-a9e35278-0c06-4cdd-9012-ec84550d6faa admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073579 Apr 12 00:23:38.071522 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 36/73] 10.222.0.32 () {60 vars in 1193 bytes} [Tue Apr 12 00:23:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:23:49.737959 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-3a60ddf5-7047-4cc9-bd95-4dbcd6ff72e5 admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:23:49.739031 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-3a60ddf5-7047-4cc9-bd95-4dbcd6ff72e5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Apr 12 00:23:49.739422 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 38/74] 10.222.0.32 () {56 vars in 1074 bytes} [Tue Apr 12 00:23:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:23:49.925487 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-8a1060c3-c9eb-45e4-a6a5-0dba3b9c4401 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:23:49.926696 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:23:49.926696 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: warnings.warn(msg) Apr 12 00:23:49.927865 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-8a1060c3-c9eb-45e4-a6a5-0dba3b9c4401 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:23:49.928297 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-8a1060c3-c9eb-45e4-a6a5-0dba3b9c4401 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:23:49.929075 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-8a1060c3-c9eb-45e4-a6a5-0dba3b9c4401 admin admin] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:23:49.929535 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-8a1060c3-c9eb-45e4-a6a5-0dba3b9c4401 admin admin] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:23:49.954544 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-8a1060c3-c9eb-45e4-a6a5-0dba3b9c4401 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079639 Apr 12 00:23:49.955087 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 37/75] 10.222.0.32 () {60 vars in 1193 bytes} [Tue Apr 12 00:23:49 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:23:51.210905 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: DEBUG nova.api.openstack.wsgi [None req-3a60ddf5-7047-4cc9-bd95-4dbcd6ff72e5 admin admin] Calling method '>' {{(pid=114121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:23:51.211889 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: INFO nova.api.openstack.requestlog [None req-3a60ddf5-7047-4cc9-bd95-4dbcd6ff72e5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Apr 12 00:23:51.212278 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: [pid: 114121|app: 0|req: 39/76] 10.222.0.32 () {56 vars in 1074 bytes} [Tue Apr 12 00:23:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:23:51.400822 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG nova.api.openstack.wsgi [None req-22ca6f28-3555-4eb2-a0cb-9fa7f53149d2 admin admin] Calling method '>' {{(pid=114122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:23:51.402033 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:23:51.402033 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: warnings.warn(msg) Apr 12 00:23:51.403281 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-22ca6f28-3555-4eb2-a0cb-9fa7f53149d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:23:51.403745 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-22ca6f28-3555-4eb2-a0cb-9fa7f53149d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:23:51.404823 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-22ca6f28-3555-4eb2-a0cb-9fa7f53149d2 admin admin] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:23:51.405243 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: DEBUG oslo_concurrency.lockutils [None req-22ca6f28-3555-4eb2-a0cb-9fa7f53149d2 admin admin] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:23:51.426007 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: INFO nova.api.openstack.requestlog [None req-22ca6f28-3555-4eb2-a0cb-9fa7f53149d2 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.075297 Apr 12 00:23:51.426525 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: [pid: 114122|app: 0|req: 38/77] 10.222.0.32 () {60 vars in 1193 bytes} [Tue Apr 12 00:23:51 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:24:49.819160 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: Tue Apr 12 00:24:49 2022 - graceful shutdown triggered... Apr 12 00:24:49.819687 dv-cinder-836252-3-iscsi devstack@n-api.service[114122]: Gracefully killing worker 2 (pid: 114122)... Apr 12 00:24:49.819252 dv-cinder-836252-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 12 00:24:49.821109 dv-cinder-836252-3-iscsi devstack@n-api.service[114121]: Gracefully killing worker 1 (pid: 114121)... Apr 12 00:24:50.819799 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: worker 1 buried after 1 seconds Apr 12 00:24:50.820219 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: worker 2 buried after 1 seconds Apr 12 00:24:50.820219 dv-cinder-836252-3-iscsi devstack@n-api.service[114120]: goodbye to uWSGI. Apr 12 00:24:50.821910 dv-cinder-836252-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 12 00:24:50.822512 dv-cinder-836252-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 12 00:24:50.825206 dv-cinder-836252-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 12 00:24:50.839464 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 12 00:24:50.858909 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 12 00:24:50 2022] *** Apr 12 00:24:50.858909 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 12 00:24:50.858909 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 12 00:24:50.858909 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: nodename: dv-cinder-836252-3-iscsi Apr 12 00:24:50.858909 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: machine: x86_64 Apr 12 00:24:50.858909 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: clock source: unix Apr 12 00:24:50.858909 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: pcre jit disabled Apr 12 00:24:50.858909 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: detected number of CPU cores: 4 Apr 12 00:24:50.858909 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: current working directory: / Apr 12 00:24:50.858909 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: detected binary path: /usr/bin/uwsgi-core Apr 12 00:24:50.859668 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: your processes number limit is 47680 Apr 12 00:24:50.859668 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: your memory page size is 4096 bytes Apr 12 00:24:50.859668 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: detected max file descriptor number: 2048 Apr 12 00:24:50.859668 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: lock engine: pthread robust mutexes Apr 12 00:24:50.859668 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: thunder lock: enabled Apr 12 00:24:50.859668 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 12 00:24:50.859668 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 12 00:24:50.905994 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: Python main interpreter initialized at 0x555a46d139c0 Apr 12 00:24:50.905994 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: python threads support enabled Apr 12 00:24:50.905994 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: your server socket listen backlog is limited to 100 connections Apr 12 00:24:50.905994 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: your mercy for graceful operations on workers is 90 seconds Apr 12 00:24:50.906488 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: mapped 403077 bytes (393 KB) for 2 cores Apr 12 00:24:50.906488 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: *** Operational MODE: preforking *** Apr 12 00:24:50.906719 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: *** uWSGI is running in multiple interpreter mode *** Apr 12 00:24:50.906719 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: spawned uWSGI master process (pid: 128470) Apr 12 00:24:50.906924 dv-cinder-836252-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 12 00:24:50.907802 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: spawned uWSGI worker 1 (pid: 128486, cores: 1) Apr 12 00:24:50.907925 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: spawned uWSGI worker 2 (pid: 128487, cores: 1) Apr 12 00:24:50.908010 dv-cinder-836252-3-iscsi devstack@n-api.service[128470]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 00:24:52.118291 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 00:24:52.125467 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 00:24:53.042581 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 00:24:53.042581 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: from cryptography.utils import int_from_bytes Apr 12 00:24:53.042909 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 00:24:53.042909 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: from cryptography.utils import int_from_bytes Apr 12 00:24:53.044800 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 00:24:53.044800 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: from cryptography.utils import int_from_bytes Apr 12 00:24:53.045121 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 00:24:53.045121 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: from cryptography.utils import int_from_bytes Apr 12 00:24:55.427971 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 00:24:55.428664 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 00:24:55.428772 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 00:24:55.429095 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 00:24:55.429350 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 00:24:55.429760 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.430084 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.430428 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.430747 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.431078 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.431389 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.431709 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.432014 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 00:24:55.432413 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.432511 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 00:24:55.432599 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.432599 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.432774 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 00:24:55.432890 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.433139 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 00:24:55.433240 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836252-3-iscsi {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.433398 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 00:24:55.433502 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.433788 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.433910 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.434108 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.434238 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.434450 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.434626 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.434735 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.434841 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.435058 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.435169 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.435359 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.435481 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.435694 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.435853 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.436014 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.436344 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.436582 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.436685 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.436888 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.436983 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.437200 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.437325 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836252-3-iscsi {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.437529 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.437642 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.437839 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.437945 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.438145 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.438279 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.438488 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.438589 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.438793 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.438894 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.439111 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.439218 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.439417 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.439517 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.439812 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836252-3-iscsi {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.439913 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.440381 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.440494 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.440590 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.440683 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.440791 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.440880 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.441119 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.441335 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.441544 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.441695 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.441786 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.441888 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.442026 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.442128 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.442360 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.442469 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.442669 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.442770 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.442981 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.443088 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.443298 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.443391 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836252-3-iscsi {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.443615 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.443711 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.443934 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.444028 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.444236 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.444339 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.444545 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.444695 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.444848 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.444975 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.445700 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.445824 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.446003 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.446111 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.446328 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.446463 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.446568 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.446772 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.446867 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.447100 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.447201 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.447421 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.447574 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.447751 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.447892 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.448028 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.448136 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.448282 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.448390 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.448599 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.448701 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.448916 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.449012 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.449221 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.449324 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.449526 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.449621 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.449829 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.449933 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.450077 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.450193 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.450413 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.450569 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.450734 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.450886 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.451036 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.451183 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.451330 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.451470 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.451615 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.451763 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.451914 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.452056 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.452210 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.452362 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.452511 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.452659 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.452798 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.452945 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.453095 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.453242 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.453397 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.453538 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.453684 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.453843 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.453991 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.454130 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.454302 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.454455 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.454616 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.454777 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.454874 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.454974 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.455112 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.455279 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.455429 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.455583 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.455752 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.455887 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.456063 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.456190 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.456385 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.456566 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.456783 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.457001 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.457095 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.457287 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.457428 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.457721 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.457721 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.457945 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.458036 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.458126 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.458220 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.458341 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.458555 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.458661 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.458855 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.458959 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.459161 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.459254 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.459461 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.459563 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.459762 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.459858 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.460064 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.460166 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.460367 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.460462 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.460693 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.460830 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.461525 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.461633 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.461831 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.461927 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.462136 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.462242 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.462466 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.462569 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.462770 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.462865 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.463075 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.463167 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.463382 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.463486 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.463684 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.463785 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.463987 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.464085 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.464290 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.464391 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.464592 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.464687 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.464895 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.464997 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.465200 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.465293 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.465501 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.465600 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.465807 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.465946 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.466110 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.466202 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.466437 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.466592 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.466753 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.466856 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.467059 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.467159 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.467363 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.467470 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.467671 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.467771 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.467967 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.468060 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.468273 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.468373 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.468590 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.468716 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.468894 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.469010 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.469195 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.469299 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.469495 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.469607 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.469795 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.469906 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.470096 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.470206 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.470420 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.470536 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.470720 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.470823 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.471020 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.471123 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.471319 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.471423 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.471628 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.471721 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.471938 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.472040 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.472241 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.472343 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.472545 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.472648 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.472848 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.472949 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.473149 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.473251 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.473456 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.473552 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.473763 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.473857 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.474069 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.474214 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.474399 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.474526 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.474708 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.474833 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.475025 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.475122 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.475322 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.475430 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.475643 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.475750 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.475956 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.476079 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.476264 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.476367 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.476593 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.476716 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.476913 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:24:55.477011 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.477222 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.477322 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.477539 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.477641 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.477855 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.477951 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.478187 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.478344 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.478525 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.478628 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.478840 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.478945 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.479156 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.479251 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.479466 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.479568 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.479781 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.479887 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.480106 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.480319 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.480458 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.480593 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.480844 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.480942 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.481029 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.481124 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.481319 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.481420 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.481638 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.481741 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.481971 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.482071 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.482305 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.482415 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.482617 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.482711 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.482926 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.483028 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.483235 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.483341 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.483554 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.483656 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.483878 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.483977 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.484188 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.484295 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.484497 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.484608 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.484804 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.484906 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.485113 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.485216 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.485421 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.485531 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.485729 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.485831 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.486037 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.486178 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.486389 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.486486 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.486703 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.486799 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.487013 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.487114 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.487320 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.487419 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.487633 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.487734 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.487941 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.488044 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.488254 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.488347 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.488560 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.488664 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.488863 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.488958 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.489164 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.489267 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.489464 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.489569 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.489772 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.489875 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.490071 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.490169 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.490411 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.490589 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.490734 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.490853 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.491040 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.491145 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.491352 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.491456 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.491655 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.491758 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.491994 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.492163 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.492315 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.492424 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.492587 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.492681 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.492888 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.492981 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.493192 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.493402 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.493503 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.493596 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.493787 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.493886 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.494104 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.494243 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.494456 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.494653 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.494754 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.495012 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.495210 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.495412 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.495556 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.495794 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.496033 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.496262 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.496537 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.496640 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.496854 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.497044 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.497290 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.497386 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.497721 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.497896 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.497991 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.498084 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.498179 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.498312 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.498404 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.498490 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.498577 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.498670 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.498757 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.498851 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.498944 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.499316 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.499411 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.499498 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.499583 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.499680 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.499768 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.499861 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.499948 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.500043 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.500186 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.500305 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.500431 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.500604 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.500743 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.500837 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.501137 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.501251 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.501379 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.501480 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.501684 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.501789 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.501987 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.502091 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.502314 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.502412 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.502633 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.502734 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.502924 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.503020 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.503226 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.503328 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.503546 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.503648 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.503853 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.503955 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.504153 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.504254 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.504455 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.504563 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.504755 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.504848 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.505060 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.505162 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.505371 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.505475 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.505678 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.505781 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.505985 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.506080 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.506309 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.506420 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.506616 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.506710 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.506921 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.507016 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.507244 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.507352 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.508088 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.508190 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.508395 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.508486 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.508699 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.508799 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.509001 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.509099 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.509319 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.509415 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.509628 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.509723 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.509944 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.510045 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.510269 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.510378 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.510594 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.510690 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.510901 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.511003 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.511221 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.511361 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.511525 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.511634 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.511835 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.511936 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.512149 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.512257 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.512462 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.512563 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.512774 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.512866 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.513090 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.513191 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.513396 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.513492 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.513709 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.513802 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.514015 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.514160 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.514330 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.514464 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.514637 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.514732 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.514945 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.515085 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.515258 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.515360 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.515564 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.515666 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.515878 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.515984 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.516183 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.516278 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.516504 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.516608 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.516809 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.516906 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.517123 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.517217 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.517425 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.517519 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.517732 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.517835 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.518045 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.518138 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.518381 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.518493 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.518693 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.518787 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.519000 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.519101 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.519308 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.519400 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.519614 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.519708 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.519920 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.520014 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.520227 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.520330 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.520530 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.520625 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.520830 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.520924 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.521135 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.521240 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.521446 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.521558 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.521749 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.521851 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.522054 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.522157 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.522375 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.522484 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.522733 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.522885 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.522984 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.523084 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.523865 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.523965 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.524169 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.524269 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.524477 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.524577 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.524783 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.524877 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.525088 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.525224 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.525395 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.525496 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.525710 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.525809 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.526013 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.526117 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.526341 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.526465 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.526647 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.526743 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.526942 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.527040 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.527241 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.527335 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.527541 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.527635 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.527840 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.528204 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.528418 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.528557 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.528737 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.528896 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.529037 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.529142 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.529348 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.529450 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.529664 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.529757 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.529966 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.530065 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.530287 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.530384 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.530595 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.530689 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.530897 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.531004 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.531199 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.531291 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.531506 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.531634 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.531809 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.531930 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.532114 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.532220 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.532419 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.532525 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.532724 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.532828 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.533028 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.533138 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.533344 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.533454 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.533647 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.533749 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.533953 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.534063 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.534280 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.534396 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.534578 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.534683 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.534883 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.534994 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.535194 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.535309 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.535504 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.535765 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.535867 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.536104 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.536211 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.536456 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.536558 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.536716 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.536872 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.537022 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.537183 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.537340 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.537523 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.537696 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.537812 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.537923 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.538019 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.538235 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.538350 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.538567 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.538684 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.538907 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.539001 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.539250 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.539479 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.539573 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.539813 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.539906 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.540128 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.540222 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.540431 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.540530 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.540734 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.540829 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.541042 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.541136 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.541344 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.541444 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.541647 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.541761 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.541944 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.542038 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.542270 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.542424 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.542579 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.542709 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.542880 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.542988 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.543189 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.543291 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.543491 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.543592 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.543809 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.543916 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.544113 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.544204 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.544410 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.544509 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.544710 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.544813 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.545010 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.545114 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.545310 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.545403 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.545612 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.545707 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.545917 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.546009 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.546234 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.546380 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.546557 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.546659 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.546885 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.547017 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.547177 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.547346 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.547501 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.547643 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.547783 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.547927 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.548077 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.548181 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.548383 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.548482 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.548686 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.548832 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.548989 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.549097 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.549290 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.549393 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.549597 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.549703 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.549903 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.550007 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.550208 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.550329 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.550536 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.550638 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.550836 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.550939 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.551142 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.551243 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.551441 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.551543 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.551753 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.551860 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.552057 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.552159 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.552356 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.552450 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.552655 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.552757 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.552955 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.553048 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.553258 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.553351 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.553558 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.553654 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.553863 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.553954 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.554161 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.554313 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.554510 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.554613 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.554811 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.554913 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.555112 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.555300 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.555496 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.555604 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.555718 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.555857 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.555996 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.556141 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.556472 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.556573 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.556815 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.557000 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.557000 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.557323 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.557422 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.557621 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.557621 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.557920 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.558053 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.558413 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.558544 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.558832 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.559035 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.559140 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.559241 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.559329 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.559421 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.559507 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.559507 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.559666 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.559749 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.559841 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.559934 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.560020 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.560152 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.560245 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.560456 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.560561 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.560757 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.560856 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.561060 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.561155 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.561359 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.561459 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.561659 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.561757 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.561957 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.562066 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.562274 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.562371 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.562583 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.562686 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.562907 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.563075 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.563212 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.563311 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.563510 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.563602 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.563812 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.563914 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.564111 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.564212 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.564414 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.564506 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.564724 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.564827 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.565028 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.565129 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.565333 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.565463 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.565637 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.565761 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.565942 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.566047 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.566293 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.566427 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.566586 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.566690 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.566896 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.567032 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.567198 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.567292 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.567501 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.567609 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.567806 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.567906 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.568122 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.568215 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.568425 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.568527 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.568727 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.568828 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.569047 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.569150 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.569356 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.569449 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.569663 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.569765 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.569985 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.570747 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.570845 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.570931 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.571153 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.571264 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.571461 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.571563 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.571766 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.571858 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.572075 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.572180 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.572380 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.572484 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.572707 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.572806 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.572989 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.573126 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.573296 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.573476 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.573605 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.573702 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.573915 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.574008 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.574220 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.574363 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.574550 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.574652 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.574856 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.574950 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.575167 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.575334 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.575474 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.575568 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.575776 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.575913 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.576298 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.576397 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.576494 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.576569 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.576670 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.576771 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.576977 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.577107 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.577280 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.577377 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.577587 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.577696 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.577889 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.577983 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.578202 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.578342 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.578534 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.578643 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.578846 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.578949 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.579155 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.579251 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.579464 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.579566 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.579791 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.579884 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.580102 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.580206 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.580409 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.580521 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.580716 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.580808 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.581009 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.581132 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.581313 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.581446 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.581619 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.581758 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.582049 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.582143 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.582383 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.582481 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.582689 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.582792 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.582992 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.583092 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.583304 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.583398 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.583608 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.583709 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.583911 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.584010 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.584213 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.584316 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.584516 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.584616 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.584822 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.584924 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.585139 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.585242 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.585535 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.585634 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.585900 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.586008 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.586206 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.586316 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.586548 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.586689 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.586862 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.587007 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.587189 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.587283 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.587497 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.587598 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.587802 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.587917 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.588109 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.588202 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.588438 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.588538 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.588744 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.588847 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.589057 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.589185 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.589381 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.589477 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.589702 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.589798 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.590012 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.590156 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.590362 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.590501 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.590644 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.590820 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.590967 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.591139 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.591290 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.591470 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.591602 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.591796 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.591924 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.592124 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.592344 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.592437 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.592646 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.592742 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.592955 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.593052 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.593276 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.593372 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.593599 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.593700 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.593905 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.594017 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.594211 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.594325 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.594543 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.594646 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.594848 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.594952 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.595150 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.595253 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.595469 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.595565 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.595772 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.595876 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.596079 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.596218 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.596387 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.596543 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.596744 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.596864 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.596990 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.597168 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.597291 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.597494 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.597598 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.597806 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.597901 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.598114 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.598215 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.598453 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.598567 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.598761 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.598855 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.599067 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.599172 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.599393 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.599574 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.599730 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.599881 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.600040 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.600191 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.600342 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.600448 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.600590 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.600693 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.600894 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.601067 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.601201 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.601895 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.602062 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.602239 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.602464 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.602563 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.602713 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.602823 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.603015 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.603110 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.603326 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.603420 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.603645 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.603739 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.603954 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.604055 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.604265 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.604369 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.604578 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.604672 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.604895 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.604988 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.605196 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.605304 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.605497 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.605601 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.605801 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.605897 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.606101 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.606205 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.606424 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.606534 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.606723 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.606833 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.607030 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.607151 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.607327 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.607477 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.607630 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.607727 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.607930 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.608026 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.608248 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.608341 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.608548 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.608642 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.608873 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.608976 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.609178 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.609280 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.609479 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.609573 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.609781 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.609889 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.610082 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.610185 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.610422 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.610570 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.610729 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.610830 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.611037 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.611132 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.611341 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.611444 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.611646 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.611748 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.611948 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.612042 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.612261 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.612362 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.612563 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.612662 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.612883 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.612976 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.613187 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.613292 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.613492 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.613595 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.613796 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.613898 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.614098 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.614202 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.614441 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.614537 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.614752 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.614852 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.615058 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.615155 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.615370 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.615464 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.615680 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.615780 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.615992 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.616089 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.616304 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.616518 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.616628 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.616846 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.617592 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.617730 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.617863 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.618044 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.618188 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.618379 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.618496 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.618699 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.618807 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.619010 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.619113 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.619320 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.619424 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.619628 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.619731 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.619936 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.620032 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.620245 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.620351 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.620559 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.620693 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.620878 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.621085 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.621193 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.621418 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.621520 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.621736 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.621830 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.622051 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.622153 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.622390 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.622489 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.622708 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.622805 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.623022 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.623135 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.623354 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.623465 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.623641 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.623783 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.623967 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.624115 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.624254 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.624441 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.624582 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.624810 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.624915 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.625010 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.625184 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.625346 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.625497 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.625693 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.625810 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.625991 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.626131 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.626228 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.626496 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.626667 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.626872 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.627039 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.627133 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.627286 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.627475 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.627568 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.627654 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.627923 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.628030 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.628120 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.628359 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.628464 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.628553 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.628640 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.628853 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.629027 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.629219 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.629368 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.629533 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.629685 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.629842 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.630018 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.630145 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.630365 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.630463 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.630691 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.630854 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.631005 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.631103 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.631322 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.631425 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.631647 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.631824 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.631953 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.632057 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.632257 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.632352 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.632590 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.632746 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.632900 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.633007 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.633225 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.633443 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.633538 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.633759 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.633855 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.634092 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.634187 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.634434 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.634543 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.634743 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.634847 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.635064 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.635271 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.635366 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.635618 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.635714 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.635934 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.636037 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.636260 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.636363 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.636579 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.636726 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.636890 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.636996 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.637194 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.637292 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.637513 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.637607 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.637816 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.637917 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.638117 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.638222 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.638453 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.638558 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.638766 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.638861 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.639070 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.639295 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.639391 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.639643 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.639736 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.639962 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.640075 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.640262 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.640364 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.640569 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.640708 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.640872 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.640967 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.641195 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.641291 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.641497 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.641593 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.641800 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.641894 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.642100 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.642197 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.642432 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.642529 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.642735 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.642840 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.643037 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.643137 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.643337 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.643437 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.643637 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.643741 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.643943 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.644046 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.644242 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.644341 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.644547 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.644651 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.644848 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.644942 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.645152 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.645244 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.645453 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.645562 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.645755 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.645855 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.646058 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.646158 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.646397 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.646495 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.646704 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.646799 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.647007 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.647112 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.647312 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.647408 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.647616 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.647723 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.648773 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.648913 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.649045 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.649160 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.649282 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.649395 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.649508 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.649628 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.649751 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.649871 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.649871 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.650093 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.650213 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.651162 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.652211 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.652332 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.652446 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.652567 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.652703 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.652819 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.653196 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.653310 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.653433 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.653546 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.653658 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.653797 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.653921 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.654036 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.654157 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.654401 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.654525 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.654653 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.654775 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.654890 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.655003 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.655129 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.655129 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.655346 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.655460 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.655580 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.655693 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.655834 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.656518 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.656653 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.656776 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.656898 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.657024 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.657147 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.657262 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.657384 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.657525 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.657640 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.657760 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.657875 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.657988 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.658101 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.658221 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.658361 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.658494 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.658617 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.658732 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.658851 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.658965 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.659087 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.659209 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.659209 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.659437 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.659551 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.659662 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.659809 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.659943 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.660074 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.660207 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.660337 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.660475 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.660616 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.660747 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.660877 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.660970 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.660970 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.661217 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.661315 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.661410 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.661504 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.661597 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.661684 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.661786 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.661875 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.662018 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.662152 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.662734 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.662883 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.663008 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.663129 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.663256 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.663372 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.663484 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.663610 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.663734 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.664387 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.664503 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.664623 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.664738 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.664868 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.664982 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.665094 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.665205 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.665437 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.665577 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.665706 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.665830 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.665943 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.666056 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.666405 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.666557 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.666711 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.666859 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.666992 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.667132 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.667265 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.667405 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.667540 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.667672 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.667811 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.667990 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.668135 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.668301 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.668438 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.668603 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.668740 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.669417 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.669568 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.669662 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.669757 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.669901 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.670033 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.670164 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.670340 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.670435 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.670523 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.670618 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.670714 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.670811 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.670899 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.670996 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.671110 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.671212 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.671419 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.671523 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.671724 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.671827 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.672031 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.672133 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.672341 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.672445 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.672648 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.672743 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.672954 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.673048 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.673258 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.673355 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.673562 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.673705 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.673869 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.673975 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.674174 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.674300 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.674519 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.674615 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.674822 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.674917 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.675127 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.675223 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.675430 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.675524 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.675733 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.675836 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.676040 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.676182 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.676345 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.676447 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.676650 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.676759 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.676954 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.677305 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.677305 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.677491 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.677580 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.677674 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.677850 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.677952 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.678159 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.678273 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.678507 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.678616 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.678831 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.678935 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.679137 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.679244 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.679550 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.680213 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.680382 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.680527 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.680709 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.680845 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.681024 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.681161 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.681333 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.681469 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.681646 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.681794 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.681945 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.682085 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.682293 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.682446 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.682593 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.682734 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.682879 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.683011 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.683182 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.683318 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.683464 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.683634 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.683780 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.683947 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.684348 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.684453 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.684555 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.684656 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.684745 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.684886 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.685035 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.685214 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.685379 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.685535 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.685689 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.685860 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.686033 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.686177 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.686453 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.686595 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.686769 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.686927 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.687080 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.687239 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.687386 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.687551 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.687646 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 00:24:55.687868 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.688179 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.688492 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.688809 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.689131 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.689461 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.689792 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.690121 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.690480 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.690829 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.691147 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.691495 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.691827 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.692145 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.692461 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.692771 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:24:55.693017 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 00:24:55.710177 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_db.sqlalchemy.engines [None req-525cfe35-f74a-4c3f-809a-d810be5f5eac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:24:55.715440 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_db.sqlalchemy.engines [None req-8c613f45-9f1f-4235-aced-7076557d7037 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:24:55.774812 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.context [None req-525cfe35-f74a-4c3f-809a-d810be5f5eac None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5ead109-62c7-446f-b4c2-717e64dca700(cell1) {{(pid=128486) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 00:24:55.779457 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-525cfe35-f74a-4c3f-809a-d810be5f5eac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:24:55.779750 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.context [None req-8c613f45-9f1f-4235-aced-7076557d7037 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5ead109-62c7-446f-b4c2-717e64dca700(cell1) {{(pid=128487) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 00:24:55.781036 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-525cfe35-f74a-4c3f-809a-d810be5f5eac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:24:55.781847 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-525cfe35-f74a-4c3f-809a-d810be5f5eac None None] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:24:55.783816 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-525cfe35-f74a-4c3f-809a-d810be5f5eac None None] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:24:55.784113 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8c613f45-9f1f-4235-aced-7076557d7037 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:24:55.785698 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8c613f45-9f1f-4235-aced-7076557d7037 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:24:55.786593 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8c613f45-9f1f-4235-aced-7076557d7037 None None] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:24:55.788579 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8c613f45-9f1f-4235-aced-7076557d7037 None None] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:24:55.795029 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_db.sqlalchemy.engines [None req-525cfe35-f74a-4c3f-809a-d810be5f5eac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:24:55.798396 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_db.sqlalchemy.engines [None req-525cfe35-f74a-4c3f-809a-d810be5f5eac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:24:55.799969 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_db.sqlalchemy.engines [None req-8c613f45-9f1f-4235-aced-7076557d7037 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:24:55.810044 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_db.sqlalchemy.engines [None req-8c613f45-9f1f-4235-aced-7076557d7037 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:24:55.965513 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_db.sqlalchemy.engines [None req-8c613f45-9f1f-4235-aced-7076557d7037 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:24:55.968879 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_db.sqlalchemy.engines [None req-525cfe35-f74a-4c3f-809a-d810be5f5eac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:24:56.395983 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: WARNING keystonemiddleware.auth_token [None req-8c613f45-9f1f-4235-aced-7076557d7037 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 00:24:56.402577 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: WARNING keystonemiddleware.auth_token [None req-8c613f45-9f1f-4235-aced-7076557d7037 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 00:24:56.410485 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: WARNING keystonemiddleware.auth_token [None req-525cfe35-f74a-4c3f-809a-d810be5f5eac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 00:24:56.417718 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: WARNING keystonemiddleware.auth_token [None req-525cfe35-f74a-4c3f-809a-d810be5f5eac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 00:24:56.625767 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: WARNING keystonemiddleware.auth_token [None req-8c613f45-9f1f-4235-aced-7076557d7037 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 00:24:56.630930 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: WARNING keystonemiddleware.auth_token [None req-8c613f45-9f1f-4235-aced-7076557d7037 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 00:24:56.636973 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a46d139c0 pid: 128487 (default app) Apr 12 00:24:56.648006 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: WARNING keystonemiddleware.auth_token [None req-525cfe35-f74a-4c3f-809a-d810be5f5eac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 00:24:56.653556 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: WARNING keystonemiddleware.auth_token [None req-525cfe35-f74a-4c3f-809a-d810be5f5eac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 00:24:56.659024 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a46d139c0 pid: 128486 (default app) Apr 12 00:25:40.510655 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f6ea43a0-54a7-495e-a05c-621a648ed43d tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] Calling method '.version_select at 0x7f64e312c700>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:42.220976 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f6ea43a0-54a7-495e-a05c-621a648ed43d tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/0c132229-558f-4282-a93a-d240e2a66497" status: 200 len: 351 microversion: 2.1 time: 2.264234 Apr 12 00:25:42.228031 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 1/1] 10.222.0.32 () {58 vars in 1244 bytes} [Tue Apr 12 00:25:39 2022] GET /compute/v2.1/os-volumes/0c132229-558f-4282-a93a-d240e2a66497 => generated 351 bytes in 2273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:25:42.330631 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9ad5c813-9caa-41e0-ad80-c48659103530 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-694021843", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452", "networks": [{"uuid": "6f42048f-da04-4010-bcf3-b5662a084b21"}]}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:42.875808 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.network.neutron [None req-9ad5c813-9caa-41e0-ad80-c48659103530 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] validate_networks() for [('6f42048f-da04-4010-bcf3-b5662a084b21', None, None, None, None, None)] {{(pid=128486) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:25:44.344810 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5545cd02-f27e-4598-adb8-17ead1f3c9f5 tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] Calling method '.version_select at 0x7f64e2fee9d0>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:44.473590 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5545cd02-f27e-4598-adb8-17ead1f3c9f5 tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/c0411bcd-8ce1-4661-92dc-4cab12950c44" status: 200 len: 350 microversion: 2.1 time: 0.132868 Apr 12 00:25:44.474169 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 2/2] 10.222.0.32 () {58 vars in 1244 bytes} [Tue Apr 12 00:25:44 2022] GET /compute/v2.1/os-volumes/c0411bcd-8ce1-4661-92dc-4cab12950c44 => generated 350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:25:46.144672 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-9ad5c813-9caa-41e0-ad80-c48659103530 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Flavor limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:25:46.145160 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-9ad5c813-9caa-41e0-ad80-c48659103530 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Image limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:25:46.145538 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-9ad5c813-9caa-41e0-ad80-c48659103530 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Flavor pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:25:46.146441 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-9ad5c813-9caa-41e0-ad80-c48659103530 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Image pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:25:46.147701 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-9ad5c813-9caa-41e0-ad80-c48659103530 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:25:46.176832 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9ad5c813-9caa-41e0-ad80-c48659103530 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:25:46.177320 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9ad5c813-9caa-41e0-ad80-c48659103530 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:25:46.178969 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9ad5c813-9caa-41e0-ad80-c48659103530 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:25:46.179496 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9ad5c813-9caa-41e0-ad80-c48659103530 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:25:46.250472 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-9ad5c813-9caa-41e0-ad80-c48659103530 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Getting quotas for project d3610d0185cf40548de23d406b26a421. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:25:46.269037 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-9ad5c813-9caa-41e0-ad80-c48659103530 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Getting quotas for user bdc08edc0e354ea0b8e41a2d81f3d9d4 and project d3610d0185cf40548de23d406b26a421. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:25:46.285154 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9ad5c813-9caa-41e0-ad80-c48659103530 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Going to run 1 instances... {{(pid=128486) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:25:46.295400 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9ad5c813-9caa-41e0-ad80-c48659103530 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:25:46.465510 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9ad5c813-9caa-41e0-ad80-c48659103530 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.797889 Apr 12 00:25:46.473155 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 1/3] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:25:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 5807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:25:46.478189 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-0fa577db-2ebe-49dc-bb56-665130c92bd8 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:46.479107 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-0fa577db-2ebe-49dc-bb56-665130c92bd8 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:25:46.699226 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-0fa577db-2ebe-49dc-bb56-665130c92bd8 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:25:46.724306 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-0fa577db-2ebe-49dc-bb56-665130c92bd8 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1214 microversion: 2.1 time: 0.250022 Apr 12 00:25:46.726861 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 3/4] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:25:46 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1214 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:25:47.593016 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e812d91e-525d-4dbf-b878-01a3cbf0a1eb tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] Calling method '.version_select at 0x7f64e26de820>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:47.746276 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-15e398ce-5001-477e-8ef7-dcbdfb6fc468 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:47.747242 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-15e398ce-5001-477e-8ef7-dcbdfb6fc468 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:25:47.764376 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e812d91e-525d-4dbf-b878-01a3cbf0a1eb tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/a3650e1f-a893-4bfd-846d-b23b91d3393d" status: 200 len: 351 microversion: 2.1 time: 0.173630 Apr 12 00:25:47.773586 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 2/5] 10.222.0.32 () {58 vars in 1244 bytes} [Tue Apr 12 00:25:47 2022] GET /compute/v2.1/os-volumes/a3650e1f-a893-4bfd-846d-b23b91d3393d => generated 351 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:25:47.779574 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7cf6aaf6-e2c2-41fc-a2bc-2ef7a743d37e tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] Calling method '.version_select at 0x7f64e1e503a0>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:47.959227 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7cf6aaf6-e2c2-41fc-a2bc-2ef7a743d37e tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.183839 Apr 12 00:25:47.968546 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 3/6] 10.222.0.32 () {58 vars in 1133 bytes} [Tue Apr 12 00:25:47 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:25:47.975364 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9dd31f8a-e7dd-4ee8-b90a-3b56a4bec778 tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] Calling method '.version_select at 0x7f64e1e50b80>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:48.148458 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9dd31f8a-e7dd-4ee8-b90a-3b56a4bec778 tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.178433 Apr 12 00:25:48.157801 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 4/7] 10.222.0.32 () {58 vars in 1148 bytes} [Tue Apr 12 00:25:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:25:48.165309 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-099f7160-6931-40a7-8966-3107031fe798 tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] Calling method '.version_select at 0x7f64e1e5e0d0>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:48.403809 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-099f7160-6931-40a7-8966-3107031fe798 tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.244410 Apr 12 00:25:48.411699 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 5/8] 10.222.0.32 () {58 vars in 1133 bytes} [Tue Apr 12 00:25:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:25:48.417208 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-06d3402d-0776-421e-87e9-9bcbc2907d24 tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] Calling method '.version_select at 0x7f64e1e5ed30>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:48.580958 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-06d3402d-0776-421e-87e9-9bcbc2907d24 tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.167768 Apr 12 00:25:48.581621 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 6/9] 10.222.0.32 () {58 vars in 1166 bytes} [Tue Apr 12 00:25:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:25:48.588291 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-15e398ce-5001-477e-8ef7-dcbdfb6fc468 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:25:48.593687 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-906bdd9e-f220-4a27-8029-8fe5ba6827fb tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] Calling method '.version_select at 0x7f64e1e5eb80>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:48.598774 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-15e398ce-5001-477e-8ef7-dcbdfb6fc468 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1214 microversion: 2.1 time: 0.859411 Apr 12 00:25:48.600267 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 4/10] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:25:47 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1214 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:25:48.835293 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-906bdd9e-f220-4a27-8029-8fe5ba6827fb tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.245350 Apr 12 00:25:48.836363 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 7/11] 10.222.0.32 () {58 vars in 1169 bytes} [Tue Apr 12 00:25:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:25:48.848476 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-ad5f9250-261c-4e82-8c4a-e224665e0243 tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] Calling method '.version_select at 0x7f64e2f744c0>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:49.090714 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-ad5f9250-261c-4e82-8c4a-e224665e0243 tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.246225 Apr 12 00:25:49.091282 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 5/12] 10.222.0.32 () {58 vars in 1154 bytes} [Tue Apr 12 00:25:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:25:49.103645 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-bd42054f-afd3-41e2-acbd-09258f3e1e89 tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] Calling method '.version_select at 0x7f64e2f749d0>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:49.359246 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-bd42054f-afd3-41e2-acbd-09258f3e1e89 tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.259978 Apr 12 00:25:49.359824 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 6/13] 10.222.0.32 () {58 vars in 1187 bytes} [Tue Apr 12 00:25:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:25:49.371395 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-14fb3fe4-ec79-4dd6-9df0-ebdb2f8248f6 tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] Calling method '.version_select at 0x7f64e2f82430>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:49.581850 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5409d3dd-b3bd-4529-833b-82aedb4840a2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Action: 'create', calling method: .version_select at 0x7f64e1e50dc0>, body: {"keypair": {"name": "tempest-keypair-675333121"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:49.600449 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-14fb3fe4-ec79-4dd6-9df0-ebdb2f8248f6 tempest-VolumesTestJSON-121199314 tempest-VolumesTestJSON-121199314-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.232102 Apr 12 00:25:49.601113 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 7/14] 10.222.0.32 () {58 vars in 1154 bytes} [Tue Apr 12 00:25:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:25:49.624024 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-35f955bf-3573-4ee6-aa7f-fb62bf3490bf tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:49.626424 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-35f955bf-3573-4ee6-aa7f-fb62bf3490bf tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:25:49.655355 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35f955bf-3573-4ee6-aa7f-fb62bf3490bf tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:25:49.658577 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35f955bf-3573-4ee6-aa7f-fb62bf3490bf tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:25:49.662530 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35f955bf-3573-4ee6-aa7f-fb62bf3490bf tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:25:49.663194 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35f955bf-3573-4ee6-aa7f-fb62bf3490bf tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:25:49.677147 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-5409d3dd-b3bd-4529-833b-82aedb4840a2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Getting quotas for project 8b482c4c00e94a25ad8f0a9034e9e0e5. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:25:49.696926 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-5409d3dd-b3bd-4529-833b-82aedb4840a2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Getting quotas for user f0fad81c4cbd4335967e97fd7de9963d and project 8b482c4c00e94a25ad8f0a9034e9e0e5. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:25:50.204970 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-35f955bf-3573-4ee6-aa7f-fb62bf3490bf tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:25:50.243347 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-35f955bf-3573-4ee6-aa7f-fb62bf3490bf tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1266 microversion: 2.1 time: 0.625510 Apr 12 00:25:50.253712 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 8/15] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:25:49 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1266 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:25:50.406229 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-5409d3dd-b3bd-4529-833b-82aedb4840a2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Getting quotas for project 8b482c4c00e94a25ad8f0a9034e9e0e5. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:25:50.432983 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-5409d3dd-b3bd-4529-833b-82aedb4840a2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Getting quotas for user f0fad81c4cbd4335967e97fd7de9963d and project 8b482c4c00e94a25ad8f0a9034e9e0e5. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:25:50.511422 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5409d3dd-b3bd-4529-833b-82aedb4840a2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.572196 Apr 12 00:25:50.523606 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 8/16] 10.222.0.32 () {62 vars in 1198 bytes} [Tue Apr 12 00:25:48 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1585 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 12 00:25:51.265166 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-281c9ae0-9e4e-408a-907f-fbbad29d493e tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:51.266409 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-281c9ae0-9e4e-408a-907f-fbbad29d493e tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:25:51.276215 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-281c9ae0-9e4e-408a-907f-fbbad29d493e tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:25:51.282424 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-281c9ae0-9e4e-408a-907f-fbbad29d493e tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:25:51.283451 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-281c9ae0-9e4e-408a-907f-fbbad29d493e tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:25:51.285153 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-281c9ae0-9e4e-408a-907f-fbbad29d493e tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:25:51.451543 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-281c9ae0-9e4e-408a-907f-fbbad29d493e tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:25:51.469419 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-281c9ae0-9e4e-408a-907f-fbbad29d493e tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1272 microversion: 2.1 time: 0.208024 Apr 12 00:25:51.478230 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 9/17] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:25:51 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:25:52.374350 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e628791d-35b6-415d-8444-12b02ff68a4d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Action: 'create', calling method: .version_select at 0x7f64e1e5e940>, body: {"keypair": {"name": "tempest-keypair-1517093374"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:52.453517 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-e628791d-35b6-415d-8444-12b02ff68a4d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Getting quotas for project c08909d19c8341c5b47846b0cee54fd8. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:25:52.492671 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9aeeae08-e348-4a8f-8d3f-b8bec3fd51e5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:52.494059 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-9aeeae08-e348-4a8f-8d3f-b8bec3fd51e5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:25:52.502126 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-e628791d-35b6-415d-8444-12b02ff68a4d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Getting quotas for user e548e01902ba41e79667ed56d602f19a and project c08909d19c8341c5b47846b0cee54fd8. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:25:52.509032 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9aeeae08-e348-4a8f-8d3f-b8bec3fd51e5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:25:52.511051 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9aeeae08-e348-4a8f-8d3f-b8bec3fd51e5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:25:52.517970 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9aeeae08-e348-4a8f-8d3f-b8bec3fd51e5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:25:52.521782 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9aeeae08-e348-4a8f-8d3f-b8bec3fd51e5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:25:53.041646 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-e628791d-35b6-415d-8444-12b02ff68a4d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Getting quotas for project c08909d19c8341c5b47846b0cee54fd8. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:25:53.060818 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-e628791d-35b6-415d-8444-12b02ff68a4d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Getting quotas for user e548e01902ba41e79667ed56d602f19a and project c08909d19c8341c5b47846b0cee54fd8. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:25:53.134177 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e628791d-35b6-415d-8444-12b02ff68a4d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.220691 Apr 12 00:25:53.136019 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 9/18] 10.222.0.32 () {60 vars in 1157 bytes} [Tue Apr 12 00:25:51 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:25:55.867445 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9aeeae08-e348-4a8f-8d3f-b8bec3fd51e5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:25:55.883265 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9aeeae08-e348-4a8f-8d3f-b8bec3fd51e5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 3.390856 Apr 12 00:25:55.905593 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 10/19] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:25:52 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 3415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:25:56.907337 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f35cc648-9044-4cb4-a9b5-d1bfa948f044 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:56.908433 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f35cc648-9044-4cb4-a9b5-d1bfa948f044 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:25:56.965596 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f35cc648-9044-4cb4-a9b5-d1bfa948f044 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:25:56.969652 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f35cc648-9044-4cb4-a9b5-d1bfa948f044 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:25:56.999390 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f35cc648-9044-4cb4-a9b5-d1bfa948f044 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:25:57.000896 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f35cc648-9044-4cb4-a9b5-d1bfa948f044 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:25:57.760341 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e1a31e87-fb25-40b9-8548-fe20de166d6b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1352219251", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:58.016134 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.network.neutron [None req-e1a31e87-fb25-40b9-8548-fe20de166d6b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] validate_networks() for [('d9c3b5d9-2a62-4930-bf1a-06e919287728', None, None, None, None, None)] {{(pid=128487) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:25:58.111667 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f35cc648-9044-4cb4-a9b5-d1bfa948f044 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:25:58.148052 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f35cc648-9044-4cb4-a9b5-d1bfa948f044 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 1.246820 Apr 12 00:25:58.149461 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 10/20] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:25:56 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:25:58.238830 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ebf59951-9c57-45ec-9f0f-d531a037862b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-736915401", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ee4ba18-669f-44db-9087-b0bd886e30c9"}], "security_groups": [{"name": "tempest-securitygroup--947064581"}], "key_name": "tempest-keypair-675333121", "user_data": "}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:58.483632 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.network.neutron [None req-ebf59951-9c57-45ec-9f0f-d531a037862b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] validate_networks() for [('1ee4ba18-669f-44db-9087-b0bd886e30c9', None, None, None, None, None)] {{(pid=128486) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:26:00.757050 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-ebf59951-9c57-45ec-9f0f-d531a037862b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Flavor limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:26:00.761339 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-ebf59951-9c57-45ec-9f0f-d531a037862b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Image limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:26:00.763040 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-ebf59951-9c57-45ec-9f0f-d531a037862b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Flavor pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:26:00.763635 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-ebf59951-9c57-45ec-9f0f-d531a037862b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Image pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:26:00.764217 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-ebf59951-9c57-45ec-9f0f-d531a037862b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:26:00.785264 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ebf59951-9c57-45ec-9f0f-d531a037862b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:00.791691 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ebf59951-9c57-45ec-9f0f-d531a037862b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:00.796799 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ebf59951-9c57-45ec-9f0f-d531a037862b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:00.798230 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ebf59951-9c57-45ec-9f0f-d531a037862b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:00.878332 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-ebf59951-9c57-45ec-9f0f-d531a037862b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Getting quotas for project 8b482c4c00e94a25ad8f0a9034e9e0e5. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:26:00.887646 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-ebf59951-9c57-45ec-9f0f-d531a037862b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Getting quotas for user f0fad81c4cbd4335967e97fd7de9963d and project 8b482c4c00e94a25ad8f0a9034e9e0e5. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:26:00.946395 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ebf59951-9c57-45ec-9f0f-d531a037862b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Going to run 1 instances... {{(pid=128486) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:26:00.948688 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ebf59951-9c57-45ec-9f0f-d531a037862b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:26:01.185729 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ebf59951-9c57-45ec-9f0f-d531a037862b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.937528 Apr 12 00:26:01.186868 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 11/21] 10.222.0.32 () {62 vars in 1187 bytes} [Tue Apr 12 00:25:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 2954 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 12 00:26:01.197059 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-aa5f2600-3337-4fae-869c-0231648e6591 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:01.197912 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-aa5f2600-3337-4fae-869c-0231648e6591 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:01.208789 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-aa5f2600-3337-4fae-869c-0231648e6591 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:01.209497 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-aa5f2600-3337-4fae-869c-0231648e6591 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:01.210486 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-aa5f2600-3337-4fae-869c-0231648e6591 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:01.211142 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-aa5f2600-3337-4fae-869c-0231648e6591 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:02.474503 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-aa5f2600-3337-4fae-869c-0231648e6591 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:02.491949 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-aa5f2600-3337-4fae-869c-0231648e6591 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 1.303663 Apr 12 00:26:02.493317 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 12/22] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:01 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:02.498557 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ba08d7f0-9a20-4c75-bcee-9b4d0bda5077 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:02.500078 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ba08d7f0-9a20-4c75-bcee-9b4d0bda5077 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:02.741411 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ba08d7f0-9a20-4c75-bcee-9b4d0bda5077 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:03.329509 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ba08d7f0-9a20-4c75-bcee-9b4d0bda5077 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:03.332424 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ba08d7f0-9a20-4c75-bcee-9b4d0bda5077 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:03.340711 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ba08d7f0-9a20-4c75-bcee-9b4d0bda5077 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1280 microversion: 2.20 time: 0.846099 Apr 12 00:26:03.354631 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 13/23] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:02 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1280 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:03.610384 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-e1a31e87-fb25-40b9-8548-fe20de166d6b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Flavor limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:26:03.612232 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-e1a31e87-fb25-40b9-8548-fe20de166d6b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Image limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:26:03.613049 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-e1a31e87-fb25-40b9-8548-fe20de166d6b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Flavor pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:26:03.613848 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-e1a31e87-fb25-40b9-8548-fe20de166d6b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Image pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:26:03.615777 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-e1a31e87-fb25-40b9-8548-fe20de166d6b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:26:03.662477 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e1a31e87-fb25-40b9-8548-fe20de166d6b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:03.664369 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e1a31e87-fb25-40b9-8548-fe20de166d6b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:03.667211 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e1a31e87-fb25-40b9-8548-fe20de166d6b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:03.668056 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e1a31e87-fb25-40b9-8548-fe20de166d6b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:03.777885 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-e1a31e87-fb25-40b9-8548-fe20de166d6b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Getting quotas for project 7bdba79df5fc4c3faa187bd65479d3f7. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:26:03.791181 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-e1a31e87-fb25-40b9-8548-fe20de166d6b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Getting quotas for user b434038833084579adf853df718315b2 and project 7bdba79df5fc4c3faa187bd65479d3f7. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:26:03.843753 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e1a31e87-fb25-40b9-8548-fe20de166d6b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Going to run 1 instances... {{(pid=128487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:26:03.852752 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e1a31e87-fb25-40b9-8548-fe20de166d6b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:26:03.925984 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-8d0008cb-3abd-4a1e-9443-969359a3720a req-e7fb3dd3-d1d5-49cc-a967-2efde5848657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514dbc1c-8df0-4bf2-96db-5911d4bdb52c", "tag": "55aa4bc9-4cd4-41c4-9139-ebefd9425766"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:03.956299 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-8d0008cb-3abd-4a1e-9443-969359a3720a req-e7fb3dd3-d1d5-49cc-a967-2efde5848657 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:03.960572 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-8d0008cb-3abd-4a1e-9443-969359a3720a req-e7fb3dd3-d1d5-49cc-a967-2efde5848657 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:04.080731 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e1a31e87-fb25-40b9-8548-fe20de166d6b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.157034 Apr 12 00:26:04.081083 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-8d0008cb-3abd-4a1e-9443-969359a3720a req-e7fb3dd3-d1d5-49cc-a967-2efde5848657 service nova] Creating event network-changed:55aa4bc9-4cd4-41c4-9139-ebefd9425766 for instance 514dbc1c-8df0-4bf2-96db-5911d4bdb52c on hv-cinder-83625 Apr 12 00:26:04.082245 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 11/24] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:25:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 7160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:26:04.092461 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-8d0008cb-3abd-4a1e-9443-969359a3720a req-e7fb3dd3-d1d5-49cc-a967-2efde5848657 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128486) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 12 00:26:04.093875 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d9f72909-c711-41f8-bc26-fcb9514fcd0f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:04.094366 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d9f72909-c711-41f8-bc26-fcb9514fcd0f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:04.095163 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d9f72909-c711-41f8-bc26-fcb9514fcd0f None None] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:04.106609 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d9f72909-c711-41f8-bc26-fcb9514fcd0f None None] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:04.125244 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d4e59ebd-5f04-45ee-a94c-91f9eb5534ea tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:04.125897 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d4e59ebd-5f04-45ee-a94c-91f9eb5534ea tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:04.159385 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.compute.rpcapi [None req-d9f72909-c711-41f8-bc26-fcb9514fcd0f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 12 00:26:04.163996 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d9f72909-c711-41f8-bc26-fcb9514fcd0f None None] Releasing lock "compute-rpcapi-router" {{(pid=128486) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 00:26:04.217938 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d4e59ebd-5f04-45ee-a94c-91f9eb5534ea tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:04.218750 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d4e59ebd-5f04-45ee-a94c-91f9eb5534ea tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:04.221402 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d4e59ebd-5f04-45ee-a94c-91f9eb5534ea tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:04.223342 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d4e59ebd-5f04-45ee-a94c-91f9eb5534ea tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:04.237586 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-d9f72909-c711-41f8-bc26-fcb9514fcd0f None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.881068 Apr 12 00:26:04.239090 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 14/25] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:26:04.326535 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a702cc07-a793-4ac4-b917-f6b6a27752d0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:04.329359 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a702cc07-a793-4ac4-b917-f6b6a27752d0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:04.714663 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a702cc07-a793-4ac4-b917-f6b6a27752d0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:04.732123 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a702cc07-a793-4ac4-b917-f6b6a27752d0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1222 microversion: 2.1 time: 0.484935 Apr 12 00:26:04.733213 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 15/26] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:04 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1222 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:04.740468 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e552e175-d8da-46c6-a768-1da64e578ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:04.742047 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e552e175-d8da-46c6-a768-1da64e578ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:04.749393 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e552e175-d8da-46c6-a768-1da64e578ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:04.750221 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e552e175-d8da-46c6-a768-1da64e578ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:04.751321 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e552e175-d8da-46c6-a768-1da64e578ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:04.752098 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e552e175-d8da-46c6-a768-1da64e578ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:05.143912 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e552e175-d8da-46c6-a768-1da64e578ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:05.164788 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e552e175-d8da-46c6-a768-1da64e578ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:05.174470 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e552e175-d8da-46c6-a768-1da64e578ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:05.178454 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e552e175-d8da-46c6-a768-1da64e578ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1332 microversion: 2.20 time: 0.443705 Apr 12 00:26:05.194769 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 16/27] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:04 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1332 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:05.498896 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-23664d33-5ac1-4263-aeb2-3c7bd0f209f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-138968499", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:05.683156 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.network.neutron [None req-23664d33-5ac1-4263-aeb2-3c7bd0f209f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] validate_networks() for [('d9c3b5d9-2a62-4930-bf1a-06e919287728', None, None, None, None, None)] {{(pid=128486) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:26:06.944040 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d4e59ebd-5f04-45ee-a94c-91f9eb5534ea tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:06.956641 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d4e59ebd-5f04-45ee-a94c-91f9eb5534ea tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 2.871534 Apr 12 00:26:06.957483 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 12/28] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:04 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 2875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:06.972244 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-67b5b81a-bf50-46ca-8c6b-5bc76f0b977d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2083426214", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5adaf9f7-3fa6-44b6-b135-6f9bef0b9df4"}], "security_groups": [{"name": "tempest-securitygroup--865008342"}], "key_name": "tempest-keypair-1517093374", "user_data": "}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:07.123618 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-23664d33-5ac1-4263-aeb2-3c7bd0f209f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Flavor limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:26:07.124186 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-23664d33-5ac1-4263-aeb2-3c7bd0f209f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Image limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:26:07.124399 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-23664d33-5ac1-4263-aeb2-3c7bd0f209f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Flavor pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:26:07.125125 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-23664d33-5ac1-4263-aeb2-3c7bd0f209f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Image pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:26:07.125752 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-23664d33-5ac1-4263-aeb2-3c7bd0f209f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:26:07.141322 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-23664d33-5ac1-4263-aeb2-3c7bd0f209f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:07.141760 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-23664d33-5ac1-4263-aeb2-3c7bd0f209f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:07.142604 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-23664d33-5ac1-4263-aeb2-3c7bd0f209f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:07.143082 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-23664d33-5ac1-4263-aeb2-3c7bd0f209f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:07.203132 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-23664d33-5ac1-4263-aeb2-3c7bd0f209f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Getting quotas for project 7bdba79df5fc4c3faa187bd65479d3f7. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:26:07.213259 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-23664d33-5ac1-4263-aeb2-3c7bd0f209f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Getting quotas for user b434038833084579adf853df718315b2 and project 7bdba79df5fc4c3faa187bd65479d3f7. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:26:07.263585 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-23664d33-5ac1-4263-aeb2-3c7bd0f209f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Going to run 1 instances... {{(pid=128486) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:26:07.265888 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-23664d33-5ac1-4263-aeb2-3c7bd0f209f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:26:07.429575 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-23664d33-5ac1-4263-aeb2-3c7bd0f209f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.936787 Apr 12 00:26:07.430229 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 17/29] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:26:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:26:07.443921 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-78437ee7-1367-49a2-9d7e-9b04c784d34d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:07.446552 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-78437ee7-1367-49a2-9d7e-9b04c784d34d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:07.480046 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-78437ee7-1367-49a2-9d7e-9b04c784d34d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:07.488860 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-78437ee7-1367-49a2-9d7e-9b04c784d34d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:07.490604 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-78437ee7-1367-49a2-9d7e-9b04c784d34d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:07.491218 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-78437ee7-1367-49a2-9d7e-9b04c784d34d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:07.874062 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.network.neutron [None req-67b5b81a-bf50-46ca-8c6b-5bc76f0b977d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] validate_networks() for [('5adaf9f7-3fa6-44b6-b135-6f9bef0b9df4', None, None, None, None, None)] {{(pid=128487) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:26:08.413030 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-78437ee7-1367-49a2-9d7e-9b04c784d34d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:08.426469 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-78437ee7-1367-49a2-9d7e-9b04c784d34d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:08.429196 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-78437ee7-1367-49a2-9d7e-9b04c784d34d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:08.430523 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-78437ee7-1367-49a2-9d7e-9b04c784d34d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.990641 Apr 12 00:26:08.442205 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 18/30] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:07 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:08.449190 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c1789221-ea54-4ae2-8b7e-cd4e3a30202f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:08.450128 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c1789221-ea54-4ae2-8b7e-cd4e3a30202f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:08.457255 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c1789221-ea54-4ae2-8b7e-cd4e3a30202f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:08.458057 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c1789221-ea54-4ae2-8b7e-cd4e3a30202f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:08.459160 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c1789221-ea54-4ae2-8b7e-cd4e3a30202f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:08.467350 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c1789221-ea54-4ae2-8b7e-cd4e3a30202f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:08.605954 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-c1789221-ea54-4ae2-8b7e-cd4e3a30202f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:08.618375 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c1789221-ea54-4ae2-8b7e-cd4e3a30202f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1225 microversion: 2.1 time: 0.173409 Apr 12 00:26:08.618823 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 19/31] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:08 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1225 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:08.626831 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-06f424d1-d1b6-4b73-8bec-df80b5abf6e8 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:08.627951 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-06f424d1-d1b6-4b73-8bec-df80b5abf6e8 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:08.636491 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-06f424d1-d1b6-4b73-8bec-df80b5abf6e8 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:08.637682 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-06f424d1-d1b6-4b73-8bec-df80b5abf6e8 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:08.639065 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-06f424d1-d1b6-4b73-8bec-df80b5abf6e8 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:08.639717 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-06f424d1-d1b6-4b73-8bec-df80b5abf6e8 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:08.884413 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-67b5b81a-bf50-46ca-8c6b-5bc76f0b977d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Flavor limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:26:08.885093 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-67b5b81a-bf50-46ca-8c6b-5bc76f0b977d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Image limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:26:08.885776 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-67b5b81a-bf50-46ca-8c6b-5bc76f0b977d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Flavor pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:26:08.886246 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-67b5b81a-bf50-46ca-8c6b-5bc76f0b977d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Image pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:26:08.886767 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-67b5b81a-bf50-46ca-8c6b-5bc76f0b977d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:26:08.908026 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-67b5b81a-bf50-46ca-8c6b-5bc76f0b977d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:08.909061 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-67b5b81a-bf50-46ca-8c6b-5bc76f0b977d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:08.910286 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-67b5b81a-bf50-46ca-8c6b-5bc76f0b977d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:08.911271 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-67b5b81a-bf50-46ca-8c6b-5bc76f0b977d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:08.947717 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-67b5b81a-bf50-46ca-8c6b-5bc76f0b977d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Getting quotas for project c08909d19c8341c5b47846b0cee54fd8. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:26:08.983011 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-67b5b81a-bf50-46ca-8c6b-5bc76f0b977d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Getting quotas for user e548e01902ba41e79667ed56d602f19a and project c08909d19c8341c5b47846b0cee54fd8. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:26:09.039423 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-67b5b81a-bf50-46ca-8c6b-5bc76f0b977d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Going to run 1 instances... {{(pid=128487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:26:09.043781 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-67b5b81a-bf50-46ca-8c6b-5bc76f0b977d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:26:09.054357 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-06f424d1-d1b6-4b73-8bec-df80b5abf6e8 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:09.077773 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-06f424d1-d1b6-4b73-8bec-df80b5abf6e8 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 0.456416 Apr 12 00:26:09.079327 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 20/32] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:08 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:09.145421 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-67b5b81a-bf50-46ca-8c6b-5bc76f0b977d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.177099 Apr 12 00:26:09.147196 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 13/33] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:26:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:26:09.158313 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-73d355dd-439b-4535-8c56-60865b8313e7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:09.158944 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-73d355dd-439b-4535-8c56-60865b8313e7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:09.372008 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-4e22b4de-0c43-4c5c-bdc7-7e289d96bfe6 req-6c58707c-77bd-4126-8b18-2cf15b3fd836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02c4e615-6c86-41a2-b6a5-19371b76e311", "tag": "a96b86a8-a90d-426f-9b7e-b2dc136b138a"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:09.405358 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-4e22b4de-0c43-4c5c-bdc7-7e289d96bfe6 req-6c58707c-77bd-4126-8b18-2cf15b3fd836 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:09.406421 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-4e22b4de-0c43-4c5c-bdc7-7e289d96bfe6 req-6c58707c-77bd-4126-8b18-2cf15b3fd836 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:09.447641 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-4e22b4de-0c43-4c5c-bdc7-7e289d96bfe6 req-6c58707c-77bd-4126-8b18-2cf15b3fd836 service nova] Creating event network-changed:a96b86a8-a90d-426f-9b7e-b2dc136b138a for instance 02c4e615-6c86-41a2-b6a5-19371b76e311 on hv-cinder-83625 Apr 12 00:26:09.448364 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-4e22b4de-0c43-4c5c-bdc7-7e289d96bfe6 req-6c58707c-77bd-4126-8b18-2cf15b3fd836 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 12 00:26:09.449524 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e3a03e0d-fa5b-4a64-88bc-0b364e5ee03e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:09.449964 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e3a03e0d-fa5b-4a64-88bc-0b364e5ee03e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:09.450780 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e3a03e0d-fa5b-4a64-88bc-0b364e5ee03e None None] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:09.453547 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e3a03e0d-fa5b-4a64-88bc-0b364e5ee03e None None] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:09.465077 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-73d355dd-439b-4535-8c56-60865b8313e7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:09.472349 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-73d355dd-439b-4535-8c56-60865b8313e7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1238 microversion: 2.1 time: 0.318536 Apr 12 00:26:09.472957 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 21/34] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:09 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1238 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:09.492077 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.compute.rpcapi [None req-e3a03e0d-fa5b-4a64-88bc-0b364e5ee03e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 12 00:26:09.494920 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e3a03e0d-fa5b-4a64-88bc-0b364e5ee03e None None] Releasing lock "compute-rpcapi-router" {{(pid=128487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 00:26:09.504959 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-673fde55-a48b-4108-b9e5-d4f1f5d07d2b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:09.505719 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-673fde55-a48b-4108-b9e5-d4f1f5d07d2b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:09.531351 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e3a03e0d-fa5b-4a64-88bc-0b364e5ee03e None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165478 Apr 12 00:26:09.532728 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 14/35] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:26:09.539783 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-673fde55-a48b-4108-b9e5-d4f1f5d07d2b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:09.542894 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-673fde55-a48b-4108-b9e5-d4f1f5d07d2b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:09.543924 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-673fde55-a48b-4108-b9e5-d4f1f5d07d2b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:09.544545 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-673fde55-a48b-4108-b9e5-d4f1f5d07d2b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:09.639674 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e2939827-b858-4f35-8f38-a9bd2be4d793 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:09.640426 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e2939827-b858-4f35-8f38-a9bd2be4d793 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:09.658589 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e2939827-b858-4f35-8f38-a9bd2be4d793 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:09.658589 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e2939827-b858-4f35-8f38-a9bd2be4d793 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:09.658589 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e2939827-b858-4f35-8f38-a9bd2be4d793 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:09.658589 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e2939827-b858-4f35-8f38-a9bd2be4d793 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:09.840194 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-673fde55-a48b-4108-b9e5-d4f1f5d07d2b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:09.850615 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-673fde55-a48b-4108-b9e5-d4f1f5d07d2b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:09.852158 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-673fde55-a48b-4108-b9e5-d4f1f5d07d2b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:09.853288 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-673fde55-a48b-4108-b9e5-d4f1f5d07d2b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.379405 Apr 12 00:26:09.857738 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 22/36] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:09 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:09.864553 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e2939827-b858-4f35-8f38-a9bd2be4d793 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:09.874155 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e2939827-b858-4f35-8f38-a9bd2be4d793 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1217 microversion: 2.1 time: 0.240683 Apr 12 00:26:09.876302 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 15/37] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:09 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1217 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:10.102523 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-860010ff-05f9-401e-a189-4e1761cd9415 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:10.103852 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-860010ff-05f9-401e-a189-4e1761cd9415 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:10.116435 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-860010ff-05f9-401e-a189-4e1761cd9415 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:10.118491 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-860010ff-05f9-401e-a189-4e1761cd9415 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:10.119520 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-860010ff-05f9-401e-a189-4e1761cd9415 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:10.120168 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-860010ff-05f9-401e-a189-4e1761cd9415 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:10.284046 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-860010ff-05f9-401e-a189-4e1761cd9415 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:10.295740 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-860010ff-05f9-401e-a189-4e1761cd9415 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 0.200227 Apr 12 00:26:10.301540 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 23/38] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:10 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:10.489789 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c3bfaee3-8807-46de-873c-a9cc6fe7461c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:10.489789 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c3bfaee3-8807-46de-873c-a9cc6fe7461c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:10.495754 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c3bfaee3-8807-46de-873c-a9cc6fe7461c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:10.496211 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c3bfaee3-8807-46de-873c-a9cc6fe7461c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:10.496971 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c3bfaee3-8807-46de-873c-a9cc6fe7461c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:10.497641 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c3bfaee3-8807-46de-873c-a9cc6fe7461c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:10.561578 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c3bfaee3-8807-46de-873c-a9cc6fe7461c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:10.569399 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c3bfaee3-8807-46de-873c-a9cc6fe7461c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1242 microversion: 2.1 time: 0.084437 Apr 12 00:26:10.570868 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 16/39] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:10 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:10.871827 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-429db619-814e-43f7-82a9-01d42e25d641 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:10.872454 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-429db619-814e-43f7-82a9-01d42e25d641 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:10.878766 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-429db619-814e-43f7-82a9-01d42e25d641 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:10.879256 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-429db619-814e-43f7-82a9-01d42e25d641 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:10.880137 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-429db619-814e-43f7-82a9-01d42e25d641 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:10.880830 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-429db619-814e-43f7-82a9-01d42e25d641 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:10.897287 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a12b6de7-e908-453a-bb19-086de9000c05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:10.897909 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a12b6de7-e908-453a-bb19-086de9000c05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:10.908096 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a12b6de7-e908-453a-bb19-086de9000c05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:10.909051 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a12b6de7-e908-453a-bb19-086de9000c05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:10.910563 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a12b6de7-e908-453a-bb19-086de9000c05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:10.911816 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a12b6de7-e908-453a-bb19-086de9000c05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:10.987637 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a12b6de7-e908-453a-bb19-086de9000c05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:10.999165 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a12b6de7-e908-453a-bb19-086de9000c05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1273 microversion: 2.1 time: 0.106131 Apr 12 00:26:10.999766 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 17/40] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:10 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:11.066564 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-429db619-814e-43f7-82a9-01d42e25d641 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:11.083980 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-429db619-814e-43f7-82a9-01d42e25d641 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:11.085883 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-429db619-814e-43f7-82a9-01d42e25d641 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:11.087135 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-429db619-814e-43f7-82a9-01d42e25d641 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.219561 Apr 12 00:26:11.087713 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 24/41] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:10 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:11.311265 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2e83ad74-213a-444d-ac10-dafeb5dcdee3 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:11.312074 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2e83ad74-213a-444d-ac10-dafeb5dcdee3 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:11.320397 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2e83ad74-213a-444d-ac10-dafeb5dcdee3 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:11.321346 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2e83ad74-213a-444d-ac10-dafeb5dcdee3 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:11.322694 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2e83ad74-213a-444d-ac10-dafeb5dcdee3 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:11.323301 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2e83ad74-213a-444d-ac10-dafeb5dcdee3 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:11.499997 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2e83ad74-213a-444d-ac10-dafeb5dcdee3 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:11.507905 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2e83ad74-213a-444d-ac10-dafeb5dcdee3 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 0.201810 Apr 12 00:26:11.508736 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 18/42] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:11 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:11.586524 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5c9b3a8b-c1f7-41b6-b657-14a67d7634b3 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:11.587276 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5c9b3a8b-c1f7-41b6-b657-14a67d7634b3 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:11.593421 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5c9b3a8b-c1f7-41b6-b657-14a67d7634b3 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:11.594079 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5c9b3a8b-c1f7-41b6-b657-14a67d7634b3 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:11.594891 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5c9b3a8b-c1f7-41b6-b657-14a67d7634b3 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:11.595336 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5c9b3a8b-c1f7-41b6-b657-14a67d7634b3 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:11.663106 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5c9b3a8b-c1f7-41b6-b657-14a67d7634b3 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:11.673409 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5c9b3a8b-c1f7-41b6-b657-14a67d7634b3 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1242 microversion: 2.1 time: 0.091513 Apr 12 00:26:11.674006 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 25/43] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:11 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:12.019595 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1866843f-b111-48f6-81ff-86bb2d884776 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:12.020663 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1866843f-b111-48f6-81ff-86bb2d884776 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:12.029138 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1866843f-b111-48f6-81ff-86bb2d884776 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:12.029626 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1866843f-b111-48f6-81ff-86bb2d884776 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:12.030602 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1866843f-b111-48f6-81ff-86bb2d884776 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:12.031270 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1866843f-b111-48f6-81ff-86bb2d884776 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:12.109063 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9b964ea0-5ea6-40ba-ae87-2ecc4a5c2cf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:12.110341 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9b964ea0-5ea6-40ba-ae87-2ecc4a5c2cf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:12.120622 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9b964ea0-5ea6-40ba-ae87-2ecc4a5c2cf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:12.121402 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9b964ea0-5ea6-40ba-ae87-2ecc4a5c2cf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:12.123993 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9b964ea0-5ea6-40ba-ae87-2ecc4a5c2cf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:12.124713 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9b964ea0-5ea6-40ba-ae87-2ecc4a5c2cf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:12.128615 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1866843f-b111-48f6-81ff-86bb2d884776 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:12.138358 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1866843f-b111-48f6-81ff-86bb2d884776 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1273 microversion: 2.1 time: 0.125647 Apr 12 00:26:12.139632 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 19/44] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:12 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:12.535076 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-6a08084b-7d96-4577-a7dd-0b476c5e47d5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:12.536408 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-6a08084b-7d96-4577-a7dd-0b476c5e47d5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:12.556499 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6a08084b-7d96-4577-a7dd-0b476c5e47d5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:12.557162 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6a08084b-7d96-4577-a7dd-0b476c5e47d5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:12.558032 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6a08084b-7d96-4577-a7dd-0b476c5e47d5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:12.558698 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6a08084b-7d96-4577-a7dd-0b476c5e47d5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:12.674132 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9b964ea0-5ea6-40ba-ae87-2ecc4a5c2cf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:12.686010 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9b964ea0-5ea6-40ba-ae87-2ecc4a5c2cf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:12.689890 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9b964ea0-5ea6-40ba-ae87-2ecc4a5c2cf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:12.691651 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9b964ea0-5ea6-40ba-ae87-2ecc4a5c2cf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.588576 Apr 12 00:26:12.694526 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 26/45] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:12 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:12.705170 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ca903596-03b1-41df-a1f9-caa4a989b14b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:12.705777 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ca903596-03b1-41df-a1f9-caa4a989b14b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:12.718652 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ca903596-03b1-41df-a1f9-caa4a989b14b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:12.719101 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ca903596-03b1-41df-a1f9-caa4a989b14b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:12.719868 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ca903596-03b1-41df-a1f9-caa4a989b14b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:12.720333 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ca903596-03b1-41df-a1f9-caa4a989b14b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:12.820862 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-6a08084b-7d96-4577-a7dd-0b476c5e47d5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:12.830282 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-6a08084b-7d96-4577-a7dd-0b476c5e47d5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 0.307483 Apr 12 00:26:12.830910 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 20/46] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:12 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:12.868582 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ca903596-03b1-41df-a1f9-caa4a989b14b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:12.879202 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ca903596-03b1-41df-a1f9-caa4a989b14b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1290 microversion: 2.1 time: 0.177829 Apr 12 00:26:12.880318 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 27/47] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:12 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1290 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:13.156023 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c1204d05-870f-499a-baae-3afb1c165ba7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:13.156641 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c1204d05-870f-499a-baae-3afb1c165ba7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:13.168736 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c1204d05-870f-499a-baae-3afb1c165ba7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:13.169284 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c1204d05-870f-499a-baae-3afb1c165ba7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:13.170106 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c1204d05-870f-499a-baae-3afb1c165ba7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:13.174959 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c1204d05-870f-499a-baae-3afb1c165ba7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:13.349472 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c1204d05-870f-499a-baae-3afb1c165ba7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:13.360684 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c1204d05-870f-499a-baae-3afb1c165ba7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1279 microversion: 2.1 time: 0.208402 Apr 12 00:26:13.362713 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 21/48] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:13 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1279 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:13.713105 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ff24150f-819b-4175-8131-e7dfe2fe473c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:13.714561 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ff24150f-819b-4175-8131-e7dfe2fe473c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:13.725054 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ff24150f-819b-4175-8131-e7dfe2fe473c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:13.727783 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ff24150f-819b-4175-8131-e7dfe2fe473c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:13.734652 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ff24150f-819b-4175-8131-e7dfe2fe473c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:13.734652 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ff24150f-819b-4175-8131-e7dfe2fe473c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:13.887893 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-8c508232-ee1a-4fda-ba44-daf58a7e763d req-8dd8c12f-daef-470d-bfe1-14f170ee542f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f7526a5-050f-4c25-8432-e85eddf41b98", "tag": "e2528e14-c8a3-4f63-b34e-364aedc6fb6a"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:13.900976 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-8c508232-ee1a-4fda-ba44-daf58a7e763d req-8dd8c12f-daef-470d-bfe1-14f170ee542f service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:13.906748 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-8c508232-ee1a-4fda-ba44-daf58a7e763d req-8dd8c12f-daef-470d-bfe1-14f170ee542f service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:13.925514 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-8c508232-ee1a-4fda-ba44-daf58a7e763d req-8dd8c12f-daef-470d-bfe1-14f170ee542f service nova] Creating event network-changed:e2528e14-c8a3-4f63-b34e-364aedc6fb6a for instance 1f7526a5-050f-4c25-8432-e85eddf41b98 on hv-cinder-83625 Apr 12 00:26:13.936644 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-8c508232-ee1a-4fda-ba44-daf58a7e763d req-8dd8c12f-daef-470d-bfe1-14f170ee542f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161725 Apr 12 00:26:13.938675 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 22/49] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:26:13.948703 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9e59378a-1c66-415f-98d6-09700fb112b1 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:13.952162 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-9e59378a-1c66-415f-98d6-09700fb112b1 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:13.961763 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9e59378a-1c66-415f-98d6-09700fb112b1 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:13.962618 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9e59378a-1c66-415f-98d6-09700fb112b1 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:13.963814 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9e59378a-1c66-415f-98d6-09700fb112b1 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:13.964467 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9e59378a-1c66-415f-98d6-09700fb112b1 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:13.964669 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ff24150f-819b-4175-8131-e7dfe2fe473c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:13.972749 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ff24150f-819b-4175-8131-e7dfe2fe473c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:13.974947 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ff24150f-819b-4175-8131-e7dfe2fe473c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:13.976400 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ff24150f-819b-4175-8131-e7dfe2fe473c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.268684 Apr 12 00:26:13.977133 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 28/50] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:13 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:13.983571 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5557b991-3160-47f8-8839-c285ff5ddfb4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:13.984331 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5557b991-3160-47f8-8839-c285ff5ddfb4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:13.991453 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5557b991-3160-47f8-8839-c285ff5ddfb4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:13.992153 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5557b991-3160-47f8-8839-c285ff5ddfb4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:13.993078 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5557b991-3160-47f8-8839-c285ff5ddfb4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:13.993838 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5557b991-3160-47f8-8839-c285ff5ddfb4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:14.081453 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5557b991-3160-47f8-8839-c285ff5ddfb4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:14.090628 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5557b991-3160-47f8-8839-c285ff5ddfb4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1296 microversion: 2.1 time: 0.111852 Apr 12 00:26:14.091518 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 29/51] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:13 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1296 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:14.235199 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9e59378a-1c66-415f-98d6-09700fb112b1 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:14.243085 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9e59378a-1c66-415f-98d6-09700fb112b1 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 0.302351 Apr 12 00:26:14.254410 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 23/52] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:13 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:14.380357 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a2a9109e-65d7-4dae-990c-ac732a82244d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:14.381282 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a2a9109e-65d7-4dae-990c-ac732a82244d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:14.396404 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a2a9109e-65d7-4dae-990c-ac732a82244d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:14.396851 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a2a9109e-65d7-4dae-990c-ac732a82244d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:14.398975 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a2a9109e-65d7-4dae-990c-ac732a82244d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:14.399430 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a2a9109e-65d7-4dae-990c-ac732a82244d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:14.575410 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a2a9109e-65d7-4dae-990c-ac732a82244d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:14.584586 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a2a9109e-65d7-4dae-990c-ac732a82244d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.209450 Apr 12 00:26:14.585875 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 30/53] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:14 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:14.995123 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4a454b4f-9bf1-4693-a9ba-3eefc167ae9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:14.995734 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-4a454b4f-9bf1-4693-a9ba-3eefc167ae9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:15.001515 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4a454b4f-9bf1-4693-a9ba-3eefc167ae9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:15.001968 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4a454b4f-9bf1-4693-a9ba-3eefc167ae9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:15.002765 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4a454b4f-9bf1-4693-a9ba-3eefc167ae9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:15.003199 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4a454b4f-9bf1-4693-a9ba-3eefc167ae9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:15.107498 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0fcfbf84-2736-471b-a6b2-bffef624d0de tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:15.108639 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0fcfbf84-2736-471b-a6b2-bffef624d0de tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:15.115077 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0fcfbf84-2736-471b-a6b2-bffef624d0de tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:15.115516 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0fcfbf84-2736-471b-a6b2-bffef624d0de tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:15.116284 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0fcfbf84-2736-471b-a6b2-bffef624d0de tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:15.116750 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0fcfbf84-2736-471b-a6b2-bffef624d0de tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:15.131976 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-4a454b4f-9bf1-4693-a9ba-3eefc167ae9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:15.140186 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-4a454b4f-9bf1-4693-a9ba-3eefc167ae9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:15.141704 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-4a454b4f-9bf1-4693-a9ba-3eefc167ae9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:15.142878 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-4a454b4f-9bf1-4693-a9ba-3eefc167ae9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.151654 Apr 12 00:26:15.143438 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 24/54] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:14 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:26:15.179916 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0fcfbf84-2736-471b-a6b2-bffef624d0de tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:15.187865 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0fcfbf84-2736-471b-a6b2-bffef624d0de tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1296 microversion: 2.1 time: 0.084860 Apr 12 00:26:15.188447 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 31/55] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:15 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:15.260001 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-ba5f5348-f286-42d1-99b5-afd0ccf087bd tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:15.260701 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-ba5f5348-f286-42d1-99b5-afd0ccf087bd tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:15.266790 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ba5f5348-f286-42d1-99b5-afd0ccf087bd tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:15.267288 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ba5f5348-f286-42d1-99b5-afd0ccf087bd tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:15.268127 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ba5f5348-f286-42d1-99b5-afd0ccf087bd tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:15.268784 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ba5f5348-f286-42d1-99b5-afd0ccf087bd tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:15.410281 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ba5f5348-f286-42d1-99b5-afd0ccf087bd tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:15.418681 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-ba5f5348-f286-42d1-99b5-afd0ccf087bd tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 0.162544 Apr 12 00:26:15.428573 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 25/56] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:15 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:15.601931 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-713be8c9-cc44-4d65-ad77-f0d927a4a1b5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:15.603221 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-713be8c9-cc44-4d65-ad77-f0d927a4a1b5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:15.614772 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-713be8c9-cc44-4d65-ad77-f0d927a4a1b5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:15.615258 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-713be8c9-cc44-4d65-ad77-f0d927a4a1b5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:15.616069 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-713be8c9-cc44-4d65-ad77-f0d927a4a1b5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:15.616504 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-713be8c9-cc44-4d65-ad77-f0d927a4a1b5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:15.923327 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-713be8c9-cc44-4d65-ad77-f0d927a4a1b5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:15.934749 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-713be8c9-cc44-4d65-ad77-f0d927a4a1b5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.335067 Apr 12 00:26:15.936779 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 32/57] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:15 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:16.161624 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a6d4a58c-5135-4af8-83c1-8fa8ef8e7ef9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:16.162441 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a6d4a58c-5135-4af8-83c1-8fa8ef8e7ef9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:16.179318 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a6d4a58c-5135-4af8-83c1-8fa8ef8e7ef9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:16.179888 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a6d4a58c-5135-4af8-83c1-8fa8ef8e7ef9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:16.180786 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a6d4a58c-5135-4af8-83c1-8fa8ef8e7ef9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:16.181363 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a6d4a58c-5135-4af8-83c1-8fa8ef8e7ef9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:16.205624 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-da15f188-0208-45a5-9a97-5f790b4ea27c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:16.206999 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-da15f188-0208-45a5-9a97-5f790b4ea27c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:16.220614 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-da15f188-0208-45a5-9a97-5f790b4ea27c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:16.221066 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-da15f188-0208-45a5-9a97-5f790b4ea27c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:16.221854 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-da15f188-0208-45a5-9a97-5f790b4ea27c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:16.222303 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-da15f188-0208-45a5-9a97-5f790b4ea27c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:16.316138 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-da15f188-0208-45a5-9a97-5f790b4ea27c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:16.326803 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-da15f188-0208-45a5-9a97-5f790b4ea27c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1296 microversion: 2.1 time: 0.125765 Apr 12 00:26:16.329211 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 33/58] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:16 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1296 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:16.438005 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-edea1130-3001-4a0c-9f86-c8e3100fb15d tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:16.438987 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-edea1130-3001-4a0c-9f86-c8e3100fb15d tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:16.450732 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-edea1130-3001-4a0c-9f86-c8e3100fb15d tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:16.451361 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-edea1130-3001-4a0c-9f86-c8e3100fb15d tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:16.453394 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-edea1130-3001-4a0c-9f86-c8e3100fb15d tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:16.454618 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-edea1130-3001-4a0c-9f86-c8e3100fb15d tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:16.719574 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-edea1130-3001-4a0c-9f86-c8e3100fb15d tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:16.731928 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-edea1130-3001-4a0c-9f86-c8e3100fb15d tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 0.299462 Apr 12 00:26:16.734223 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 34/59] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:16 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:16.969590 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a6d4a58c-5135-4af8-83c1-8fa8ef8e7ef9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:16.983766 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a6d4a58c-5135-4af8-83c1-8fa8ef8e7ef9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:16.994491 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a6d4a58c-5135-4af8-83c1-8fa8ef8e7ef9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:16.997319 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a6d4a58c-5135-4af8-83c1-8fa8ef8e7ef9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.839019 Apr 12 00:26:16.999027 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 26/60] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:16 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:17.007036 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-023ee4b1-b0cf-4f24-97c9-3a288a3bf056 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:17.007992 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-023ee4b1-b0cf-4f24-97c9-3a288a3bf056 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:17.024866 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-023ee4b1-b0cf-4f24-97c9-3a288a3bf056 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:17.025818 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-023ee4b1-b0cf-4f24-97c9-3a288a3bf056 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:17.035167 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-023ee4b1-b0cf-4f24-97c9-3a288a3bf056 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:17.035627 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-023ee4b1-b0cf-4f24-97c9-3a288a3bf056 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:17.039305 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-52b81360-62f2-43a3-ad0d-7f577e19a5af req-bf166062-838b-48e9-9c64-8050edaf8d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514dbc1c-8df0-4bf2-96db-5911d4bdb52c", "name": "network-vif-plugged", "status": "completed", "tag": "55aa4bc9-4cd4-41c4-9139-ebefd9425766"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:17.049073 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-52b81360-62f2-43a3-ad0d-7f577e19a5af req-bf166062-838b-48e9-9c64-8050edaf8d72 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:17.049679 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-52b81360-62f2-43a3-ad0d-7f577e19a5af req-bf166062-838b-48e9-9c64-8050edaf8d72 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:17.064071 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-52b81360-62f2-43a3-ad0d-7f577e19a5af req-bf166062-838b-48e9-9c64-8050edaf8d72 service nova] Creating event network-vif-plugged:55aa4bc9-4cd4-41c4-9139-ebefd9425766 for instance 514dbc1c-8df0-4bf2-96db-5911d4bdb52c on hv-cinder-83625 Apr 12 00:26:17.070397 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-52b81360-62f2-43a3-ad0d-7f577e19a5af req-bf166062-838b-48e9-9c64-8050edaf8d72 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138085 Apr 12 00:26:17.071354 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 35/61] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:26:17.334973 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-023ee4b1-b0cf-4f24-97c9-3a288a3bf056 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:17.342457 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-023ee4b1-b0cf-4f24-97c9-3a288a3bf056 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.341442 Apr 12 00:26:17.352462 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 27/62] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:16 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:17.352645 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-fc3ff884-f88c-435d-9f03-16b194e59a82 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:17.352645 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-fc3ff884-f88c-435d-9f03-16b194e59a82 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:17.355807 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fc3ff884-f88c-435d-9f03-16b194e59a82 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:17.356261 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fc3ff884-f88c-435d-9f03-16b194e59a82 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:17.357037 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fc3ff884-f88c-435d-9f03-16b194e59a82 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:17.357680 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fc3ff884-f88c-435d-9f03-16b194e59a82 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:17.423239 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-fc3ff884-f88c-435d-9f03-16b194e59a82 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:17.431185 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-fc3ff884-f88c-435d-9f03-16b194e59a82 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1296 microversion: 2.1 time: 0.087885 Apr 12 00:26:17.431777 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 36/63] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:17 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:17.708585 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-a9b14320-f7dc-42f8-844e-980b43eeb3f9 req-d77cc7d7-40a7-4de1-92f1-b9b9619fcb6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "436e51f9-0f9a-4bb2-a03e-b53050e1dc80", "tag": "d8fd308a-3656-4572-a37f-0f014a01f3f9"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:17.717342 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-a9b14320-f7dc-42f8-844e-980b43eeb3f9 req-d77cc7d7-40a7-4de1-92f1-b9b9619fcb6b service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:17.717970 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-a9b14320-f7dc-42f8-844e-980b43eeb3f9 req-d77cc7d7-40a7-4de1-92f1-b9b9619fcb6b service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:17.729996 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-a9b14320-f7dc-42f8-844e-980b43eeb3f9 req-d77cc7d7-40a7-4de1-92f1-b9b9619fcb6b service nova] Creating event network-changed:d8fd308a-3656-4572-a37f-0f014a01f3f9 for instance 436e51f9-0f9a-4bb2-a03e-b53050e1dc80 on hv-cinder-83625 Apr 12 00:26:17.739520 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-a9b14320-f7dc-42f8-844e-980b43eeb3f9 req-d77cc7d7-40a7-4de1-92f1-b9b9619fcb6b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034470 Apr 12 00:26:17.740655 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 28/64] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:26:17.749921 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7040a765-24f2-42b7-be82-e984beff3681 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:17.750874 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7040a765-24f2-42b7-be82-e984beff3681 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:17.757769 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7040a765-24f2-42b7-be82-e984beff3681 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:17.758401 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7040a765-24f2-42b7-be82-e984beff3681 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:17.759266 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7040a765-24f2-42b7-be82-e984beff3681 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:17.759707 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7040a765-24f2-42b7-be82-e984beff3681 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:17.897050 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7040a765-24f2-42b7-be82-e984beff3681 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:17.904841 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7040a765-24f2-42b7-be82-e984beff3681 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 0.158885 Apr 12 00:26:17.905413 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 37/65] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:17 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:18.016814 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-60a9c9e3-68a3-40da-9f1e-c9d0f9955f86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:18.017502 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-60a9c9e3-68a3-40da-9f1e-c9d0f9955f86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:18.024302 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-60a9c9e3-68a3-40da-9f1e-c9d0f9955f86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:18.024695 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-60a9c9e3-68a3-40da-9f1e-c9d0f9955f86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:18.025466 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-60a9c9e3-68a3-40da-9f1e-c9d0f9955f86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:18.025932 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-60a9c9e3-68a3-40da-9f1e-c9d0f9955f86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:18.155732 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-60a9c9e3-68a3-40da-9f1e-c9d0f9955f86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:18.163495 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-60a9c9e3-68a3-40da-9f1e-c9d0f9955f86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:18.165001 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-60a9c9e3-68a3-40da-9f1e-c9d0f9955f86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:18.166105 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-60a9c9e3-68a3-40da-9f1e-c9d0f9955f86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.153541 Apr 12 00:26:18.166717 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 29/66] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:18 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:18.359936 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-90391f48-cc8c-4533-be96-134d42679fcf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:18.360505 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-90391f48-cc8c-4533-be96-134d42679fcf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:18.366980 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-90391f48-cc8c-4533-be96-134d42679fcf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:18.367463 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-90391f48-cc8c-4533-be96-134d42679fcf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:18.368254 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-90391f48-cc8c-4533-be96-134d42679fcf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:18.368723 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-90391f48-cc8c-4533-be96-134d42679fcf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:18.448553 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-17660cd2-414e-40cf-8a70-2d27c0b7fb3d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:18.449171 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-17660cd2-414e-40cf-8a70-2d27c0b7fb3d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:18.455143 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-17660cd2-414e-40cf-8a70-2d27c0b7fb3d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:18.455634 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-17660cd2-414e-40cf-8a70-2d27c0b7fb3d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:18.456401 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-17660cd2-414e-40cf-8a70-2d27c0b7fb3d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:18.456840 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-17660cd2-414e-40cf-8a70-2d27c0b7fb3d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:18.495899 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-90391f48-cc8c-4533-be96-134d42679fcf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:18.503391 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-90391f48-cc8c-4533-be96-134d42679fcf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.147386 Apr 12 00:26:18.503967 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 38/67] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:18 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:18.579774 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-17660cd2-414e-40cf-8a70-2d27c0b7fb3d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:18.586879 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-17660cd2-414e-40cf-8a70-2d27c0b7fb3d tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.142135 Apr 12 00:26:18.587442 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 30/68] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:18 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:18.922301 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-32d46ed3-7234-4f33-bfd2-00b1c24f0b23 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:18.922813 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-32d46ed3-7234-4f33-bfd2-00b1c24f0b23 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:18.929227 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-32d46ed3-7234-4f33-bfd2-00b1c24f0b23 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:18.929676 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-32d46ed3-7234-4f33-bfd2-00b1c24f0b23 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:18.930462 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-32d46ed3-7234-4f33-bfd2-00b1c24f0b23 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:18.930892 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-32d46ed3-7234-4f33-bfd2-00b1c24f0b23 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:19.054448 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-32d46ed3-7234-4f33-bfd2-00b1c24f0b23 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:19.061897 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-32d46ed3-7234-4f33-bfd2-00b1c24f0b23 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 0.143597 Apr 12 00:26:19.062500 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 39/69] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:18 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:19.184141 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e1c94810-572b-4a52-948e-bfcef0a48414 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:19.184745 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e1c94810-572b-4a52-948e-bfcef0a48414 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:19.190461 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e1c94810-572b-4a52-948e-bfcef0a48414 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:19.190904 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e1c94810-572b-4a52-948e-bfcef0a48414 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:19.191647 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e1c94810-572b-4a52-948e-bfcef0a48414 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:19.192072 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e1c94810-572b-4a52-948e-bfcef0a48414 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:19.316038 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e1c94810-572b-4a52-948e-bfcef0a48414 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:19.323602 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e1c94810-572b-4a52-948e-bfcef0a48414 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:19.325127 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e1c94810-572b-4a52-948e-bfcef0a48414 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:19.326208 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e1c94810-572b-4a52-948e-bfcef0a48414 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.145892 Apr 12 00:26:19.326795 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 31/70] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:19 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:19.521091 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-45ce449f-ae81-4876-9bd7-016663a1990b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:19.521615 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-45ce449f-ae81-4876-9bd7-016663a1990b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:19.527784 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-45ce449f-ae81-4876-9bd7-016663a1990b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:19.528229 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-45ce449f-ae81-4876-9bd7-016663a1990b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:19.528973 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-45ce449f-ae81-4876-9bd7-016663a1990b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:19.529400 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-45ce449f-ae81-4876-9bd7-016663a1990b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:19.603609 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-41770b90-88ab-4a54-923e-0610da0d3687 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:19.604290 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-41770b90-88ab-4a54-923e-0610da0d3687 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:19.610298 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-41770b90-88ab-4a54-923e-0610da0d3687 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:19.610846 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-41770b90-88ab-4a54-923e-0610da0d3687 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:19.611684 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-41770b90-88ab-4a54-923e-0610da0d3687 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:19.612187 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-41770b90-88ab-4a54-923e-0610da0d3687 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:19.763289 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-41770b90-88ab-4a54-923e-0610da0d3687 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:19.771472 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-41770b90-88ab-4a54-923e-0610da0d3687 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.171727 Apr 12 00:26:19.771995 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 32/71] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:19 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:19.802362 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-45ce449f-ae81-4876-9bd7-016663a1990b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:19.810501 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-45ce449f-ae81-4876-9bd7-016663a1990b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.293766 Apr 12 00:26:19.811387 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 40/72] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:19 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:20.078405 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2329be79-0040-4c77-a259-7211951e4e5b tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:20.079010 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2329be79-0040-4c77-a259-7211951e4e5b tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:20.084764 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2329be79-0040-4c77-a259-7211951e4e5b tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:20.085209 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2329be79-0040-4c77-a259-7211951e4e5b tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:20.085954 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2329be79-0040-4c77-a259-7211951e4e5b tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:20.086410 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2329be79-0040-4c77-a259-7211951e4e5b tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:20.208962 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2329be79-0040-4c77-a259-7211951e4e5b tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:20.216037 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2329be79-0040-4c77-a259-7211951e4e5b tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 0.141498 Apr 12 00:26:20.216597 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 33/73] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:20 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:20.343725 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b30d7efc-0ab1-4244-8996-257a2d13771e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:20.344261 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b30d7efc-0ab1-4244-8996-257a2d13771e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:20.350065 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b30d7efc-0ab1-4244-8996-257a2d13771e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:20.350537 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b30d7efc-0ab1-4244-8996-257a2d13771e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:20.351284 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b30d7efc-0ab1-4244-8996-257a2d13771e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:20.351737 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b30d7efc-0ab1-4244-8996-257a2d13771e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:20.473427 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b30d7efc-0ab1-4244-8996-257a2d13771e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:20.481081 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b30d7efc-0ab1-4244-8996-257a2d13771e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:20.482589 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b30d7efc-0ab1-4244-8996-257a2d13771e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:20.483668 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b30d7efc-0ab1-4244-8996-257a2d13771e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.143860 Apr 12 00:26:20.484235 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 41/74] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:20 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:20.788821 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-0b203262-a3de-41db-9506-afeb6bd70093 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:20.789461 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-0b203262-a3de-41db-9506-afeb6bd70093 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:20.795474 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b203262-a3de-41db-9506-afeb6bd70093 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:20.795972 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b203262-a3de-41db-9506-afeb6bd70093 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:20.796773 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b203262-a3de-41db-9506-afeb6bd70093 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:20.797212 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b203262-a3de-41db-9506-afeb6bd70093 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:20.827729 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-138fd4ed-6487-49b9-a7be-d5912fded0cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:20.828458 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-138fd4ed-6487-49b9-a7be-d5912fded0cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:20.835323 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-138fd4ed-6487-49b9-a7be-d5912fded0cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:20.835999 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-138fd4ed-6487-49b9-a7be-d5912fded0cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:20.836850 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-138fd4ed-6487-49b9-a7be-d5912fded0cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:20.837284 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-138fd4ed-6487-49b9-a7be-d5912fded0cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:20.942582 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-0b203262-a3de-41db-9506-afeb6bd70093 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:20.950146 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-0b203262-a3de-41db-9506-afeb6bd70093 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.165554 Apr 12 00:26:20.950745 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 34/75] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:20 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:20.976724 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-138fd4ed-6487-49b9-a7be-d5912fded0cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:20.984116 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-138fd4ed-6487-49b9-a7be-d5912fded0cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.160144 Apr 12 00:26:20.984689 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 42/76] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:20 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:21.232556 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-50307b53-aa53-4e06-b35e-613ee92da269 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:21.233167 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-50307b53-aa53-4e06-b35e-613ee92da269 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:21.239611 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-50307b53-aa53-4e06-b35e-613ee92da269 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:21.240062 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-50307b53-aa53-4e06-b35e-613ee92da269 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:21.240815 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-50307b53-aa53-4e06-b35e-613ee92da269 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:21.241244 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-50307b53-aa53-4e06-b35e-613ee92da269 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:21.363799 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-50307b53-aa53-4e06-b35e-613ee92da269 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:21.371148 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-50307b53-aa53-4e06-b35e-613ee92da269 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 0.142329 Apr 12 00:26:21.371722 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 35/77] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:21 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:21.501909 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-fd1e195c-dcd8-44d0-8d41-7fda15bfab90 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:21.502481 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-fd1e195c-dcd8-44d0-8d41-7fda15bfab90 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:21.508275 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fd1e195c-dcd8-44d0-8d41-7fda15bfab90 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:21.508713 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fd1e195c-dcd8-44d0-8d41-7fda15bfab90 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:21.509465 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fd1e195c-dcd8-44d0-8d41-7fda15bfab90 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:21.509894 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fd1e195c-dcd8-44d0-8d41-7fda15bfab90 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:21.630938 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-fd1e195c-dcd8-44d0-8d41-7fda15bfab90 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:21.638498 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-fd1e195c-dcd8-44d0-8d41-7fda15bfab90 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:21.639978 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-fd1e195c-dcd8-44d0-8d41-7fda15bfab90 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:21.641054 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-fd1e195c-dcd8-44d0-8d41-7fda15bfab90 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.143153 Apr 12 00:26:21.641610 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 43/78] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:21 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:21.966891 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-6d3c74e1-b435-4019-8034-7f08edaf1442 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:21.968150 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-6d3c74e1-b435-4019-8034-7f08edaf1442 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:21.974364 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6d3c74e1-b435-4019-8034-7f08edaf1442 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:21.974809 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6d3c74e1-b435-4019-8034-7f08edaf1442 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:21.975908 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6d3c74e1-b435-4019-8034-7f08edaf1442 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:21.976335 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6d3c74e1-b435-4019-8034-7f08edaf1442 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:22.001964 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9033ed20-38f9-40b3-8aac-44139e51791a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:22.002601 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9033ed20-38f9-40b3-8aac-44139e51791a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:22.009006 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9033ed20-38f9-40b3-8aac-44139e51791a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:22.009455 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9033ed20-38f9-40b3-8aac-44139e51791a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:22.010207 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9033ed20-38f9-40b3-8aac-44139e51791a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:22.010659 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9033ed20-38f9-40b3-8aac-44139e51791a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:22.155934 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-6d3c74e1-b435-4019-8034-7f08edaf1442 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:22.169131 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-6d3c74e1-b435-4019-8034-7f08edaf1442 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.206478 Apr 12 00:26:22.172638 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 36/79] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:21 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:22.172741 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9033ed20-38f9-40b3-8aac-44139e51791a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:22.182751 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9033ed20-38f9-40b3-8aac-44139e51791a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.183982 Apr 12 00:26:22.189698 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 44/80] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:21 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:22.388786 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-eef5ff37-4806-4b0f-8642-9d4784ff1275 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:22.389430 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-eef5ff37-4806-4b0f-8642-9d4784ff1275 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:22.395793 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-eef5ff37-4806-4b0f-8642-9d4784ff1275 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:22.396243 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-eef5ff37-4806-4b0f-8642-9d4784ff1275 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:22.397000 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-eef5ff37-4806-4b0f-8642-9d4784ff1275 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:22.397429 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-eef5ff37-4806-4b0f-8642-9d4784ff1275 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:22.677235 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7100723e-d116-4b97-988d-c3eba7366a22 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:22.678428 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7100723e-d116-4b97-988d-c3eba7366a22 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:22.689255 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7100723e-d116-4b97-988d-c3eba7366a22 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:22.689899 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7100723e-d116-4b97-988d-c3eba7366a22 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:22.691109 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7100723e-d116-4b97-988d-c3eba7366a22 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:22.692356 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7100723e-d116-4b97-988d-c3eba7366a22 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:22.839853 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7100723e-d116-4b97-988d-c3eba7366a22 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:22.847731 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7100723e-d116-4b97-988d-c3eba7366a22 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:22.850091 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7100723e-d116-4b97-988d-c3eba7366a22 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:22.851220 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7100723e-d116-4b97-988d-c3eba7366a22 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.195169 Apr 12 00:26:22.851790 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 45/81] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:22 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:22.888538 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-eef5ff37-4806-4b0f-8642-9d4784ff1275 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:22.896738 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-eef5ff37-4806-4b0f-8642-9d4784ff1275 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 0.511632 Apr 12 00:26:22.897246 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 37/82] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:22 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:23.185215 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f119edd7-6e64-484d-9afc-8f91bfc1f7aa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:23.185972 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f119edd7-6e64-484d-9afc-8f91bfc1f7aa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:23.192346 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f119edd7-6e64-484d-9afc-8f91bfc1f7aa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:23.192799 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f119edd7-6e64-484d-9afc-8f91bfc1f7aa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:23.193739 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f119edd7-6e64-484d-9afc-8f91bfc1f7aa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:23.194182 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f119edd7-6e64-484d-9afc-8f91bfc1f7aa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:23.202429 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2fef5b8b-2ff7-4fa1-b647-8da759fe2d75 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:23.203877 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2fef5b8b-2ff7-4fa1-b647-8da759fe2d75 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:23.213490 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2fef5b8b-2ff7-4fa1-b647-8da759fe2d75 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:23.215671 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2fef5b8b-2ff7-4fa1-b647-8da759fe2d75 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:23.217119 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2fef5b8b-2ff7-4fa1-b647-8da759fe2d75 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:23.217953 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2fef5b8b-2ff7-4fa1-b647-8da759fe2d75 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:23.402175 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f119edd7-6e64-484d-9afc-8f91bfc1f7aa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:23.412686 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f119edd7-6e64-484d-9afc-8f91bfc1f7aa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.231567 Apr 12 00:26:23.413453 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 46/83] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:23 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:23.420940 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-a1b5730b-f5d9-44c1-a30a-9823db0ca863 req-fb40264c-4fc9-4c4e-9bab-06c453e025da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6812d1c1-9663-404e-a23f-db9a8dc7e766", "tag": "9859cd42-a040-4515-a314-efe078c16231"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:23.456691 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-a1b5730b-f5d9-44c1-a30a-9823db0ca863 req-fb40264c-4fc9-4c4e-9bab-06c453e025da service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:23.457137 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-a1b5730b-f5d9-44c1-a30a-9823db0ca863 req-fb40264c-4fc9-4c4e-9bab-06c453e025da service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:23.473631 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-a1b5730b-f5d9-44c1-a30a-9823db0ca863 req-fb40264c-4fc9-4c4e-9bab-06c453e025da service nova] Creating event network-changed:9859cd42-a040-4515-a314-efe078c16231 for instance 6812d1c1-9663-404e-a23f-db9a8dc7e766 on hv-cinder-83625 Apr 12 00:26:23.485066 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-a1b5730b-f5d9-44c1-a30a-9823db0ca863 req-fb40264c-4fc9-4c4e-9bab-06c453e025da service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067722 Apr 12 00:26:23.485858 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 47/84] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:26:23.528200 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2fef5b8b-2ff7-4fa1-b647-8da759fe2d75 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:23.538353 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2fef5b8b-2ff7-4fa1-b647-8da759fe2d75 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.342457 Apr 12 00:26:23.539173 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 38/85] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:23 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:23.869664 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1d6d1c2b-abf6-40f6-ab91-d94b2e83672b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:23.870428 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1d6d1c2b-abf6-40f6-ab91-d94b2e83672b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:23.876438 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1d6d1c2b-abf6-40f6-ab91-d94b2e83672b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:23.876892 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1d6d1c2b-abf6-40f6-ab91-d94b2e83672b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:23.877658 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1d6d1c2b-abf6-40f6-ab91-d94b2e83672b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:23.878088 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1d6d1c2b-abf6-40f6-ab91-d94b2e83672b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:23.912930 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-13298352-91a7-4d6a-b8a1-a1c81e682258 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:23.913816 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-13298352-91a7-4d6a-b8a1-a1c81e682258 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:23.921008 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-13298352-91a7-4d6a-b8a1-a1c81e682258 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:23.921603 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-13298352-91a7-4d6a-b8a1-a1c81e682258 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:23.922504 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-13298352-91a7-4d6a-b8a1-a1c81e682258 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:23.923155 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-13298352-91a7-4d6a-b8a1-a1c81e682258 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:24.008249 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1d6d1c2b-abf6-40f6-ab91-d94b2e83672b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:24.016435 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1d6d1c2b-abf6-40f6-ab91-d94b2e83672b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:24.017960 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1d6d1c2b-abf6-40f6-ab91-d94b2e83672b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:24.019128 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1d6d1c2b-abf6-40f6-ab91-d94b2e83672b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.153860 Apr 12 00:26:24.019722 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 48/86] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:23 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:24.359070 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-13298352-91a7-4d6a-b8a1-a1c81e682258 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:24.361470 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-93197320-a436-4ed8-b992-fe797618a651 req-33b54df8-3d76-4be9-aa48-5dac7f1d3ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c4e615-6c86-41a2-b6a5-19371b76e311", "name": "network-vif-plugged", "status": "completed", "tag": "a96b86a8-a90d-426f-9b7e-b2dc136b138a"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:24.370191 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-13298352-91a7-4d6a-b8a1-a1c81e682258 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1314 microversion: 2.1 time: 0.461077 Apr 12 00:26:24.370864 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 39/87] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:23 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:24.389940 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-93197320-a436-4ed8-b992-fe797618a651 req-33b54df8-3d76-4be9-aa48-5dac7f1d3ce1 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:24.395786 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-93197320-a436-4ed8-b992-fe797618a651 req-33b54df8-3d76-4be9-aa48-5dac7f1d3ce1 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:24.430111 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-93197320-a436-4ed8-b992-fe797618a651 req-33b54df8-3d76-4be9-aa48-5dac7f1d3ce1 service nova] Creating event network-vif-plugged:a96b86a8-a90d-426f-9b7e-b2dc136b138a for instance 02c4e615-6c86-41a2-b6a5-19371b76e311 on hv-cinder-83625 Apr 12 00:26:24.432676 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-60a0cc57-65c0-487d-96ad-04361d8bf7c1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:24.433465 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-60a0cc57-65c0-487d-96ad-04361d8bf7c1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:24.440073 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-60a0cc57-65c0-487d-96ad-04361d8bf7c1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:24.440473 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-60a0cc57-65c0-487d-96ad-04361d8bf7c1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:24.442546 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-93197320-a436-4ed8-b992-fe797618a651 req-33b54df8-3d76-4be9-aa48-5dac7f1d3ce1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085909 Apr 12 00:26:24.443555 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 49/88] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:26:24.448544 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-60a0cc57-65c0-487d-96ad-04361d8bf7c1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:24.449395 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-60a0cc57-65c0-487d-96ad-04361d8bf7c1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:24.557029 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-762a0cff-dd4f-40e5-9e8b-f90298dedb14 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:24.558141 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-762a0cff-dd4f-40e5-9e8b-f90298dedb14 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:24.568061 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-762a0cff-dd4f-40e5-9e8b-f90298dedb14 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:24.568987 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-762a0cff-dd4f-40e5-9e8b-f90298dedb14 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:24.570506 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-762a0cff-dd4f-40e5-9e8b-f90298dedb14 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:24.571107 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-762a0cff-dd4f-40e5-9e8b-f90298dedb14 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:24.840908 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-762a0cff-dd4f-40e5-9e8b-f90298dedb14 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:24.851590 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-762a0cff-dd4f-40e5-9e8b-f90298dedb14 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.298947 Apr 12 00:26:24.856238 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 50/89] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:24 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:24.894534 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-60a0cc57-65c0-487d-96ad-04361d8bf7c1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:24.901500 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-60a0cc57-65c0-487d-96ad-04361d8bf7c1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.472508 Apr 12 00:26:24.902930 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 40/90] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:24 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:25.039365 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a60941b7-ae01-4473-a448-47d0a4e27675 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:25.040779 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a60941b7-ae01-4473-a448-47d0a4e27675 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:25.051882 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a60941b7-ae01-4473-a448-47d0a4e27675 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:25.052273 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a60941b7-ae01-4473-a448-47d0a4e27675 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:25.053685 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a60941b7-ae01-4473-a448-47d0a4e27675 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:25.054225 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a60941b7-ae01-4473-a448-47d0a4e27675 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:25.229219 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a60941b7-ae01-4473-a448-47d0a4e27675 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:25.239234 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a60941b7-ae01-4473-a448-47d0a4e27675 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:25.240942 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a60941b7-ae01-4473-a448-47d0a4e27675 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:25.242219 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a60941b7-ae01-4473-a448-47d0a4e27675 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.208676 Apr 12 00:26:25.252986 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 51/91] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:25 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:25.392135 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-eda02f05-f4f9-4eb4-b6f3-01fec96f06a4 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:25.393823 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-eda02f05-f4f9-4eb4-b6f3-01fec96f06a4 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:25.403278 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-eda02f05-f4f9-4eb4-b6f3-01fec96f06a4 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:25.403948 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-eda02f05-f4f9-4eb4-b6f3-01fec96f06a4 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:25.405416 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-eda02f05-f4f9-4eb4-b6f3-01fec96f06a4 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:25.406192 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-eda02f05-f4f9-4eb4-b6f3-01fec96f06a4 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:25.667984 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-eda02f05-f4f9-4eb4-b6f3-01fec96f06a4 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:25.675940 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-eda02f05-f4f9-4eb4-b6f3-01fec96f06a4 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1500 microversion: 2.1 time: 0.289471 Apr 12 00:26:25.677163 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 41/92] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:25 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1500 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:25.873427 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ee059fef-cf67-49bd-b9f5-e28f3bb5af6a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:25.874202 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ee059fef-cf67-49bd-b9f5-e28f3bb5af6a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:25.885509 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ee059fef-cf67-49bd-b9f5-e28f3bb5af6a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:25.885976 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ee059fef-cf67-49bd-b9f5-e28f3bb5af6a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:25.889923 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ee059fef-cf67-49bd-b9f5-e28f3bb5af6a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:25.890683 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ee059fef-cf67-49bd-b9f5-e28f3bb5af6a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:25.921224 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-35a65e73-7a92-4e28-833e-8b297c0f6001 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:25.921668 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-35a65e73-7a92-4e28-833e-8b297c0f6001 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:25.930109 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35a65e73-7a92-4e28-833e-8b297c0f6001 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:25.930764 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35a65e73-7a92-4e28-833e-8b297c0f6001 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:25.931760 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35a65e73-7a92-4e28-833e-8b297c0f6001 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:25.932404 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35a65e73-7a92-4e28-833e-8b297c0f6001 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:26.094342 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ee059fef-cf67-49bd-b9f5-e28f3bb5af6a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:26.111675 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ee059fef-cf67-49bd-b9f5-e28f3bb5af6a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.242101 Apr 12 00:26:26.112082 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-35a65e73-7a92-4e28-833e-8b297c0f6001 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:26.115505 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 52/93] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:25 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:26.124748 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-35a65e73-7a92-4e28-833e-8b297c0f6001 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.206769 Apr 12 00:26:26.124748 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 42/94] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:25 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:26.273083 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a9f06696-a2d7-4d76-955e-19448eae48ab tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:26.274371 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a9f06696-a2d7-4d76-955e-19448eae48ab tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:26.283346 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a9f06696-a2d7-4d76-955e-19448eae48ab tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:26.284493 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a9f06696-a2d7-4d76-955e-19448eae48ab tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:26.286414 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a9f06696-a2d7-4d76-955e-19448eae48ab tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:26.287126 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a9f06696-a2d7-4d76-955e-19448eae48ab tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:26.488125 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a9f06696-a2d7-4d76-955e-19448eae48ab tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:26.497002 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a9f06696-a2d7-4d76-955e-19448eae48ab tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:26.498534 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a9f06696-a2d7-4d76-955e-19448eae48ab tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:26.499817 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a9f06696-a2d7-4d76-955e-19448eae48ab tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.242784 Apr 12 00:26:26.500555 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 43/95] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:26 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:27.136144 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0367964e-6bbb-4b0f-a58b-6c6e84c18859 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:27.137852 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0367964e-6bbb-4b0f-a58b-6c6e84c18859 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:27.141242 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d4e8de2c-4108-40f1-8ed5-9944b28f23fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:27.141905 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d4e8de2c-4108-40f1-8ed5-9944b28f23fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:27.145078 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0367964e-6bbb-4b0f-a58b-6c6e84c18859 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:27.146500 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0367964e-6bbb-4b0f-a58b-6c6e84c18859 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:27.147488 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0367964e-6bbb-4b0f-a58b-6c6e84c18859 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:27.148124 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0367964e-6bbb-4b0f-a58b-6c6e84c18859 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:27.151739 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d4e8de2c-4108-40f1-8ed5-9944b28f23fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:27.152287 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d4e8de2c-4108-40f1-8ed5-9944b28f23fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:27.154784 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d4e8de2c-4108-40f1-8ed5-9944b28f23fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:27.155656 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d4e8de2c-4108-40f1-8ed5-9944b28f23fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:27.376066 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0367964e-6bbb-4b0f-a58b-6c6e84c18859 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:27.384498 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0367964e-6bbb-4b0f-a58b-6c6e84c18859 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.256270 Apr 12 00:26:27.396951 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 53/96] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:27 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:27.417688 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d4e8de2c-4108-40f1-8ed5-9944b28f23fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:27.419547 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f0b4b304-77ab-4853-adac-34a5f1ee941e tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00ddb69d-2eeb-4728-92e7-eefbb839ec3a"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:27.420705 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f0b4b304-77ab-4853-adac-34a5f1ee941e tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:27.424874 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d4e8de2c-4108-40f1-8ed5-9944b28f23fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.287904 Apr 12 00:26:27.428397 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 44/97] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:27 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:27.434842 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f0b4b304-77ab-4853-adac-34a5f1ee941e tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:27.436008 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f0b4b304-77ab-4853-adac-34a5f1ee941e tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:27.437005 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f0b4b304-77ab-4853-adac-34a5f1ee941e tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:27.437613 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f0b4b304-77ab-4853-adac-34a5f1ee941e tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:27.518382 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1cf7c788-91d0-4863-8629-cc4649be9935 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:27.519083 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1cf7c788-91d0-4863-8629-cc4649be9935 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:27.529585 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1cf7c788-91d0-4863-8629-cc4649be9935 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:27.530598 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1cf7c788-91d0-4863-8629-cc4649be9935 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:27.532460 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1cf7c788-91d0-4863-8629-cc4649be9935 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:27.533153 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1cf7c788-91d0-4863-8629-cc4649be9935 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:27.716296 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1cf7c788-91d0-4863-8629-cc4649be9935 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:27.738949 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1cf7c788-91d0-4863-8629-cc4649be9935 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:27.740630 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1cf7c788-91d0-4863-8629-cc4649be9935 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:27.741758 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1cf7c788-91d0-4863-8629-cc4649be9935 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.228030 Apr 12 00:26:27.744334 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 45/98] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:27 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:28.116696 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f0b4b304-77ab-4853-adac-34a5f1ee941e tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "POST /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717940 Apr 12 00:26:28.119143 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 54/99] 10.222.0.32 () {60 vars in 1322 bytes} [Tue Apr 12 00:26:27 2022] POST /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c/os-volume_attachments => generated 194 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:26:28.406326 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-be1197bf-4404-4bed-8872-843dd85d0afc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:28.407059 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-be1197bf-4404-4bed-8872-843dd85d0afc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:28.432874 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-be1197bf-4404-4bed-8872-843dd85d0afc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:28.436607 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-be1197bf-4404-4bed-8872-843dd85d0afc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:28.437843 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-be1197bf-4404-4bed-8872-843dd85d0afc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:28.438841 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-be1197bf-4404-4bed-8872-843dd85d0afc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:28.446510 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-53482678-39e8-45de-842b-7dc5d60377ec tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:28.447212 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-53482678-39e8-45de-842b-7dc5d60377ec tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:28.461914 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-53482678-39e8-45de-842b-7dc5d60377ec tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:28.465835 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-53482678-39e8-45de-842b-7dc5d60377ec tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:28.466905 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-53482678-39e8-45de-842b-7dc5d60377ec tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:28.468939 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-53482678-39e8-45de-842b-7dc5d60377ec tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:28.648240 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-53482678-39e8-45de-842b-7dc5d60377ec tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:28.658547 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-be1197bf-4404-4bed-8872-843dd85d0afc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:28.672220 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-53482678-39e8-45de-842b-7dc5d60377ec tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.230851 Apr 12 00:26:28.674453 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 55/100] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:28 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:28.675169 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-be1197bf-4404-4bed-8872-843dd85d0afc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.273772 Apr 12 00:26:28.678366 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 46/101] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:28 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:28.759401 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8391b8a8-5540-401c-9293-4f09f230cba8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:28.760233 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8391b8a8-5540-401c-9293-4f09f230cba8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:28.766098 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8391b8a8-5540-401c-9293-4f09f230cba8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:28.766580 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8391b8a8-5540-401c-9293-4f09f230cba8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:28.767589 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8391b8a8-5540-401c-9293-4f09f230cba8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:28.768022 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8391b8a8-5540-401c-9293-4f09f230cba8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:28.907424 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8391b8a8-5540-401c-9293-4f09f230cba8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:28.915666 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8391b8a8-5540-401c-9293-4f09f230cba8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:28.917158 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8391b8a8-5540-401c-9293-4f09f230cba8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:28.918465 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8391b8a8-5540-401c-9293-4f09f230cba8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.162874 Apr 12 00:26:28.919159 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 56/102] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:28 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:26:29.690945 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d295a77d-34a0-4e59-aac4-bf73886601b8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:29.692321 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e8cc74a6-9129-4a0c-8b58-330b2b001e45 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:29.692867 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d295a77d-34a0-4e59-aac4-bf73886601b8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:29.693523 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e8cc74a6-9129-4a0c-8b58-330b2b001e45 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:29.699000 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d295a77d-34a0-4e59-aac4-bf73886601b8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:29.699660 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d295a77d-34a0-4e59-aac4-bf73886601b8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:29.700311 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e8cc74a6-9129-4a0c-8b58-330b2b001e45 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:29.700763 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e8cc74a6-9129-4a0c-8b58-330b2b001e45 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:29.701082 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d295a77d-34a0-4e59-aac4-bf73886601b8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:29.701522 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e8cc74a6-9129-4a0c-8b58-330b2b001e45 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:29.701916 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d295a77d-34a0-4e59-aac4-bf73886601b8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:29.702045 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e8cc74a6-9129-4a0c-8b58-330b2b001e45 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:29.850744 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e8cc74a6-9129-4a0c-8b58-330b2b001e45 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:29.854150 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d295a77d-34a0-4e59-aac4-bf73886601b8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:29.860654 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e8cc74a6-9129-4a0c-8b58-330b2b001e45 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.172038 Apr 12 00:26:29.861962 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 57/103] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:29 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:29.862599 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d295a77d-34a0-4e59-aac4-bf73886601b8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.176454 Apr 12 00:26:29.863413 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 47/104] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:29 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:29.938500 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1d7bb0d7-1549-4b16-9131-1fd836590b78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:29.939895 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1d7bb0d7-1549-4b16-9131-1fd836590b78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:29.946585 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1d7bb0d7-1549-4b16-9131-1fd836590b78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:29.947284 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1d7bb0d7-1549-4b16-9131-1fd836590b78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:29.948126 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1d7bb0d7-1549-4b16-9131-1fd836590b78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:29.948625 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1d7bb0d7-1549-4b16-9131-1fd836590b78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:30.092770 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1d7bb0d7-1549-4b16-9131-1fd836590b78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:30.101222 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1d7bb0d7-1549-4b16-9131-1fd836590b78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:30.102746 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1d7bb0d7-1549-4b16-9131-1fd836590b78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:30.103833 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1d7bb0d7-1549-4b16-9131-1fd836590b78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.169231 Apr 12 00:26:30.104603 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 58/105] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:29 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:30.879268 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a64be6b8-c6a6-4fe6-a0b4-d3a67957a48c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:30.879940 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a64be6b8-c6a6-4fe6-a0b4-d3a67957a48c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:30.881360 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-67ade4e3-31ea-4843-aafc-cd7dca08ab86 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:30.882540 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-67ade4e3-31ea-4843-aafc-cd7dca08ab86 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:30.889442 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a64be6b8-c6a6-4fe6-a0b4-d3a67957a48c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:30.889898 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a64be6b8-c6a6-4fe6-a0b4-d3a67957a48c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:30.891988 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a64be6b8-c6a6-4fe6-a0b4-d3a67957a48c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:30.892463 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a64be6b8-c6a6-4fe6-a0b4-d3a67957a48c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:30.893454 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-67ade4e3-31ea-4843-aafc-cd7dca08ab86 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:30.894115 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-67ade4e3-31ea-4843-aafc-cd7dca08ab86 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:30.896139 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-67ade4e3-31ea-4843-aafc-cd7dca08ab86 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:30.896837 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-67ade4e3-31ea-4843-aafc-cd7dca08ab86 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:31.127222 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a64be6b8-c6a6-4fe6-a0b4-d3a67957a48c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:31.132914 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a64be6b8-c6a6-4fe6-a0b4-d3a67957a48c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.259045 Apr 12 00:26:31.133507 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 48/106] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:30 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:31.139527 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-298e167f-9216-490a-ad7b-9f5c57d74529 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:31.140132 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-298e167f-9216-490a-ad7b-9f5c57d74529 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:31.146713 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-298e167f-9216-490a-ad7b-9f5c57d74529 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:31.147161 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-298e167f-9216-490a-ad7b-9f5c57d74529 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:31.148287 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-298e167f-9216-490a-ad7b-9f5c57d74529 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:31.148729 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-298e167f-9216-490a-ad7b-9f5c57d74529 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:31.171715 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-67ade4e3-31ea-4843-aafc-cd7dca08ab86 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:31.183144 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-67ade4e3-31ea-4843-aafc-cd7dca08ab86 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.307534 Apr 12 00:26:31.183835 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 59/107] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:30 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:31.337104 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-298e167f-9216-490a-ad7b-9f5c57d74529 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:31.349176 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-298e167f-9216-490a-ad7b-9f5c57d74529 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:31.351013 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-298e167f-9216-490a-ad7b-9f5c57d74529 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:31.352143 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-298e167f-9216-490a-ad7b-9f5c57d74529 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1405 microversion: 2.20 time: 0.217732 Apr 12 00:26:31.354460 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 49/108] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:31 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:32.150219 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b6d7f300-81cc-421a-9a11-c038635c32ca tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:32.150642 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b6d7f300-81cc-421a-9a11-c038635c32ca tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:32.157129 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b6d7f300-81cc-421a-9a11-c038635c32ca tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:32.157575 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b6d7f300-81cc-421a-9a11-c038635c32ca tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:32.158526 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b6d7f300-81cc-421a-9a11-c038635c32ca tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:32.158958 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b6d7f300-81cc-421a-9a11-c038635c32ca tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:32.199962 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-71c0ae71-7e1c-4dc4-ab02-3a19e16c249e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:32.200633 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-71c0ae71-7e1c-4dc4-ab02-3a19e16c249e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:32.208446 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71c0ae71-7e1c-4dc4-ab02-3a19e16c249e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:32.209290 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71c0ae71-7e1c-4dc4-ab02-3a19e16c249e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:32.210575 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71c0ae71-7e1c-4dc4-ab02-3a19e16c249e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:32.212378 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71c0ae71-7e1c-4dc4-ab02-3a19e16c249e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:32.322611 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b6d7f300-81cc-421a-9a11-c038635c32ca tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:32.330861 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b6d7f300-81cc-421a-9a11-c038635c32ca tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.185451 Apr 12 00:26:32.331738 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 60/109] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:32 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:32.352542 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-1e5dd426-c3f2-41ae-bd42-2ae60d42b692 req-36738ace-fee5-4e3a-96f0-6052432a3be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7526a5-050f-4c25-8432-e85eddf41b98", "name": "network-vif-plugged", "status": "completed", "tag": "e2528e14-c8a3-4f63-b34e-364aedc6fb6a"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:32.362905 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-1e5dd426-c3f2-41ae-bd42-2ae60d42b692 req-36738ace-fee5-4e3a-96f0-6052432a3be1 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:32.363807 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-1e5dd426-c3f2-41ae-bd42-2ae60d42b692 req-36738ace-fee5-4e3a-96f0-6052432a3be1 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:32.377954 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-1e5dd426-c3f2-41ae-bd42-2ae60d42b692 req-36738ace-fee5-4e3a-96f0-6052432a3be1 service nova] Creating event network-vif-plugged:e2528e14-c8a3-4f63-b34e-364aedc6fb6a for instance 1f7526a5-050f-4c25-8432-e85eddf41b98 on hv-cinder-83625 Apr 12 00:26:32.385158 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-1e5dd426-c3f2-41ae-bd42-2ae60d42b692 req-36738ace-fee5-4e3a-96f0-6052432a3be1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037139 Apr 12 00:26:32.386115 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 61/110] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:26:32.393877 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5ddacf53-8608-4555-8a05-fbfb374a0ebe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:32.395535 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5ddacf53-8608-4555-8a05-fbfb374a0ebe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:32.403718 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5ddacf53-8608-4555-8a05-fbfb374a0ebe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:32.404489 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5ddacf53-8608-4555-8a05-fbfb374a0ebe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:32.405487 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5ddacf53-8608-4555-8a05-fbfb374a0ebe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:32.406095 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5ddacf53-8608-4555-8a05-fbfb374a0ebe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:32.460025 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-71c0ae71-7e1c-4dc4-ab02-3a19e16c249e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:32.491555 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-71c0ae71-7e1c-4dc4-ab02-3a19e16c249e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.295305 Apr 12 00:26:32.492741 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 50/111] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:32 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:32.571900 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5ddacf53-8608-4555-8a05-fbfb374a0ebe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:32.580611 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5ddacf53-8608-4555-8a05-fbfb374a0ebe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:32.586553 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5ddacf53-8608-4555-8a05-fbfb374a0ebe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:32.586938 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5ddacf53-8608-4555-8a05-fbfb374a0ebe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1598 microversion: 2.20 time: 0.199577 Apr 12 00:26:32.589764 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 62/112] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:26:32 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1598 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:26:32.608167 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c4dcdfed-4c12-49a2-9edc-e91463d2359a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:32.608659 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c4dcdfed-4c12-49a2-9edc-e91463d2359a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:32.619700 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4dcdfed-4c12-49a2-9edc-e91463d2359a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:32.620397 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4dcdfed-4c12-49a2-9edc-e91463d2359a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:32.621431 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4dcdfed-4c12-49a2-9edc-e91463d2359a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:32.622270 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4dcdfed-4c12-49a2-9edc-e91463d2359a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:32.755453 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c4dcdfed-4c12-49a2-9edc-e91463d2359a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.151572 Apr 12 00:26:32.756040 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 51/113] 10.222.0.32 () {60 vars in 1315 bytes} [Tue Apr 12 00:26:32 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:26:33.348251 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a778864b-b47f-4b1d-b914-f4c406565291 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:33.349413 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a778864b-b47f-4b1d-b914-f4c406565291 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:33.356776 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a778864b-b47f-4b1d-b914-f4c406565291 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:33.357538 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a778864b-b47f-4b1d-b914-f4c406565291 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:33.358335 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a778864b-b47f-4b1d-b914-f4c406565291 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:33.358772 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a778864b-b47f-4b1d-b914-f4c406565291 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:33.508177 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4a876c8a-35bf-43ce-ac0f-4e3914a003cd tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:33.509412 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-4a876c8a-35bf-43ce-ac0f-4e3914a003cd tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:33.518096 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4a876c8a-35bf-43ce-ac0f-4e3914a003cd tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:33.518722 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4a876c8a-35bf-43ce-ac0f-4e3914a003cd tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:33.520337 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4a876c8a-35bf-43ce-ac0f-4e3914a003cd tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:33.520918 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4a876c8a-35bf-43ce-ac0f-4e3914a003cd tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:33.680643 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-4a876c8a-35bf-43ce-ac0f-4e3914a003cd tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:33.689319 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-4a876c8a-35bf-43ce-ac0f-4e3914a003cd tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.184938 Apr 12 00:26:33.690419 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 52/114] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:33 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:33.807808 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a778864b-b47f-4b1d-b914-f4c406565291 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:33.817378 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a778864b-b47f-4b1d-b914-f4c406565291 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.472938 Apr 12 00:26:33.818053 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 63/115] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:33 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:34.389178 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-caf89203-2cc4-449e-b8a5-ba45705f9178 req-f2f6b006-afed-4ae6-b3b3-af745160d7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02c4e615-6c86-41a2-b6a5-19371b76e311", "tag": "a96b86a8-a90d-426f-9b7e-b2dc136b138a"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:34.404544 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-caf89203-2cc4-449e-b8a5-ba45705f9178 req-f2f6b006-afed-4ae6-b3b3-af745160d7e1 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:34.404996 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-caf89203-2cc4-449e-b8a5-ba45705f9178 req-f2f6b006-afed-4ae6-b3b3-af745160d7e1 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:34.424652 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-caf89203-2cc4-449e-b8a5-ba45705f9178 req-f2f6b006-afed-4ae6-b3b3-af745160d7e1 service nova] Creating event network-changed:a96b86a8-a90d-426f-9b7e-b2dc136b138a for instance 02c4e615-6c86-41a2-b6a5-19371b76e311 on hv-cinder-83625 Apr 12 00:26:34.438637 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-caf89203-2cc4-449e-b8a5-ba45705f9178 req-f2f6b006-afed-4ae6-b3b3-af745160d7e1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053989 Apr 12 00:26:34.439629 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 53/116] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:26:34.706591 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4ece1e5e-25c4-487e-a865-7651c63447e5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:34.707818 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4ece1e5e-25c4-487e-a865-7651c63447e5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:34.714869 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4ece1e5e-25c4-487e-a865-7651c63447e5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:34.716154 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4ece1e5e-25c4-487e-a865-7651c63447e5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:34.717472 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4ece1e5e-25c4-487e-a865-7651c63447e5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:34.718074 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4ece1e5e-25c4-487e-a865-7651c63447e5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:34.836960 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-94c9f564-28dc-41d7-ae56-ebf67a293a8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:34.838382 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-94c9f564-28dc-41d7-ae56-ebf67a293a8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:34.847103 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-94c9f564-28dc-41d7-ae56-ebf67a293a8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:34.848227 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-94c9f564-28dc-41d7-ae56-ebf67a293a8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:34.850700 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-94c9f564-28dc-41d7-ae56-ebf67a293a8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:34.851336 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-94c9f564-28dc-41d7-ae56-ebf67a293a8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:34.906462 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4ece1e5e-25c4-487e-a865-7651c63447e5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:34.914424 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4ece1e5e-25c4-487e-a865-7651c63447e5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.211508 Apr 12 00:26:34.924825 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 64/117] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:34 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:35.032746 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-94c9f564-28dc-41d7-ae56-ebf67a293a8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:35.049465 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-94c9f564-28dc-41d7-ae56-ebf67a293a8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.218968 Apr 12 00:26:35.060512 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 54/118] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:34 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:35.932771 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3e129a19-10b9-4624-a093-c620bd57c5ae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:35.933554 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3e129a19-10b9-4624-a093-c620bd57c5ae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:35.940404 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3e129a19-10b9-4624-a093-c620bd57c5ae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:35.941020 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3e129a19-10b9-4624-a093-c620bd57c5ae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:35.942532 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3e129a19-10b9-4624-a093-c620bd57c5ae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:35.943057 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3e129a19-10b9-4624-a093-c620bd57c5ae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:36.066573 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1f7202e6-af31-4189-b5e8-b2be536dbe60 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:36.067191 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1f7202e6-af31-4189-b5e8-b2be536dbe60 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:36.073062 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1f7202e6-af31-4189-b5e8-b2be536dbe60 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:36.073451 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1f7202e6-af31-4189-b5e8-b2be536dbe60 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:36.074496 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1f7202e6-af31-4189-b5e8-b2be536dbe60 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:36.074970 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1f7202e6-af31-4189-b5e8-b2be536dbe60 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:36.128263 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3e129a19-10b9-4624-a093-c620bd57c5ae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:36.136016 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3e129a19-10b9-4624-a093-c620bd57c5ae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.207776 Apr 12 00:26:36.137188 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 65/119] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:35 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:36.273406 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1f7202e6-af31-4189-b5e8-b2be536dbe60 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:36.281337 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1f7202e6-af31-4189-b5e8-b2be536dbe60 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.218636 Apr 12 00:26:36.282075 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 55/120] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:36 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:37.153537 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-58e0b1b8-771e-42df-9cfe-f1c9df5c4d5b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:37.154137 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-58e0b1b8-771e-42df-9cfe-f1c9df5c4d5b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:37.160894 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-58e0b1b8-771e-42df-9cfe-f1c9df5c4d5b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:37.161342 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-58e0b1b8-771e-42df-9cfe-f1c9df5c4d5b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:37.162092 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-58e0b1b8-771e-42df-9cfe-f1c9df5c4d5b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:37.162540 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-58e0b1b8-771e-42df-9cfe-f1c9df5c4d5b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:37.294235 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-58e0b1b8-771e-42df-9cfe-f1c9df5c4d5b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:37.298902 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d817c528-a0e5-4c05-ae12-b0fedac88b96 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:37.300106 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d817c528-a0e5-4c05-ae12-b0fedac88b96 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:37.306321 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-58e0b1b8-771e-42df-9cfe-f1c9df5c4d5b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.156714 Apr 12 00:26:37.307243 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 66/121] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:37 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:37.307678 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d817c528-a0e5-4c05-ae12-b0fedac88b96 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:37.308136 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d817c528-a0e5-4c05-ae12-b0fedac88b96 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:37.309588 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d817c528-a0e5-4c05-ae12-b0fedac88b96 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:37.310061 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d817c528-a0e5-4c05-ae12-b0fedac88b96 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:37.445488 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d817c528-a0e5-4c05-ae12-b0fedac88b96 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:37.452898 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d817c528-a0e5-4c05-ae12-b0fedac88b96 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.157887 Apr 12 00:26:37.453467 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 56/122] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:37 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:38.323315 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1b84fb9e-4030-468e-87b1-674c902d0c7e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:38.323930 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1b84fb9e-4030-468e-87b1-674c902d0c7e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:38.330146 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1b84fb9e-4030-468e-87b1-674c902d0c7e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:38.330628 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1b84fb9e-4030-468e-87b1-674c902d0c7e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:38.331389 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1b84fb9e-4030-468e-87b1-674c902d0c7e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:38.331826 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1b84fb9e-4030-468e-87b1-674c902d0c7e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:38.461545 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1b84fb9e-4030-468e-87b1-674c902d0c7e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:38.469804 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1b84fb9e-4030-468e-87b1-674c902d0c7e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.150094 Apr 12 00:26:38.474322 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-177994b9-2a6e-4d6e-ab7a-8a8ee48babe0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:38.474322 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-177994b9-2a6e-4d6e-ab7a-8a8ee48babe0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:38.476440 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 67/123] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:38 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:38.478547 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-177994b9-2a6e-4d6e-ab7a-8a8ee48babe0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:38.479054 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-177994b9-2a6e-4d6e-ab7a-8a8ee48babe0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:38.480138 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-177994b9-2a6e-4d6e-ab7a-8a8ee48babe0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:38.480569 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-177994b9-2a6e-4d6e-ab7a-8a8ee48babe0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:38.614620 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-177994b9-2a6e-4d6e-ab7a-8a8ee48babe0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:38.621801 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-177994b9-2a6e-4d6e-ab7a-8a8ee48babe0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.156563 Apr 12 00:26:38.622394 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 57/124] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:38 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:39.486336 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-74688081-117d-4cd3-86ef-0651ca660628 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:39.486876 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-74688081-117d-4cd3-86ef-0651ca660628 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:39.493553 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-74688081-117d-4cd3-86ef-0651ca660628 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:39.493998 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-74688081-117d-4cd3-86ef-0651ca660628 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:39.494849 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-74688081-117d-4cd3-86ef-0651ca660628 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:39.495282 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-74688081-117d-4cd3-86ef-0651ca660628 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:39.630953 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-74688081-117d-4cd3-86ef-0651ca660628 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:39.638475 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-74688081-117d-4cd3-86ef-0651ca660628 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.155972 Apr 12 00:26:39.639021 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-35bd7422-6be1-47fe-87c3-1f95991fc452 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:39.639758 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-35bd7422-6be1-47fe-87c3-1f95991fc452 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:39.642577 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 68/125] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:39 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:39.646871 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35bd7422-6be1-47fe-87c3-1f95991fc452 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:39.647438 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35bd7422-6be1-47fe-87c3-1f95991fc452 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:39.648301 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35bd7422-6be1-47fe-87c3-1f95991fc452 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:39.648930 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35bd7422-6be1-47fe-87c3-1f95991fc452 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:39.861212 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-35bd7422-6be1-47fe-87c3-1f95991fc452 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:39.873333 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-35bd7422-6be1-47fe-87c3-1f95991fc452 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.238296 Apr 12 00:26:39.874273 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 58/126] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:39 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:40.070013 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-21a8ddb4-6209-49ce-ab99-96f75525c416 req-71e9f0ca-c5b5-4fc1-a073-c11c44c72ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "436e51f9-0f9a-4bb2-a03e-b53050e1dc80", "name": "network-vif-plugged", "status": "completed", "tag": "d8fd308a-3656-4572-a37f-0f014a01f3f9"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:40.078094 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-21a8ddb4-6209-49ce-ab99-96f75525c416 req-71e9f0ca-c5b5-4fc1-a073-c11c44c72ba3 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:40.078560 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-21a8ddb4-6209-49ce-ab99-96f75525c416 req-71e9f0ca-c5b5-4fc1-a073-c11c44c72ba3 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:40.106520 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-21a8ddb4-6209-49ce-ab99-96f75525c416 req-71e9f0ca-c5b5-4fc1-a073-c11c44c72ba3 service nova] Creating event network-vif-plugged:d8fd308a-3656-4572-a37f-0f014a01f3f9 for instance 436e51f9-0f9a-4bb2-a03e-b53050e1dc80 on hv-cinder-83625 Apr 12 00:26:40.111588 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-21a8ddb4-6209-49ce-ab99-96f75525c416 req-71e9f0ca-c5b5-4fc1-a073-c11c44c72ba3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045612 Apr 12 00:26:40.112652 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 69/127] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:26:40.656773 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9e7ae0c4-1b99-4a5a-bb46-4e3c63de8991 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:40.657709 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-9e7ae0c4-1b99-4a5a-bb46-4e3c63de8991 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:40.665070 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9e7ae0c4-1b99-4a5a-bb46-4e3c63de8991 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:40.665617 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9e7ae0c4-1b99-4a5a-bb46-4e3c63de8991 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:40.666425 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9e7ae0c4-1b99-4a5a-bb46-4e3c63de8991 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:40.666900 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9e7ae0c4-1b99-4a5a-bb46-4e3c63de8991 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:40.891426 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f28a0ec2-26f5-4e34-ba79-978582faf8f3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:40.892658 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f28a0ec2-26f5-4e34-ba79-978582faf8f3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:40.899836 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f28a0ec2-26f5-4e34-ba79-978582faf8f3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:40.900283 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f28a0ec2-26f5-4e34-ba79-978582faf8f3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:40.901296 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f28a0ec2-26f5-4e34-ba79-978582faf8f3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:40.901727 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f28a0ec2-26f5-4e34-ba79-978582faf8f3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:40.915611 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9e7ae0c4-1b99-4a5a-bb46-4e3c63de8991 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:40.922964 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9e7ae0c4-1b99-4a5a-bb46-4e3c63de8991 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.270289 Apr 12 00:26:40.932430 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 59/128] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:40 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:41.029547 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f28a0ec2-26f5-4e34-ba79-978582faf8f3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:41.037461 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f28a0ec2-26f5-4e34-ba79-978582faf8f3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.150267 Apr 12 00:26:41.038030 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 70/129] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:40 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:41.941965 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-ffb4b80c-b46f-4310-9618-b374abd665ec tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:41.942868 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-ffb4b80c-b46f-4310-9618-b374abd665ec tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:41.950346 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ffb4b80c-b46f-4310-9618-b374abd665ec tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:41.950999 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ffb4b80c-b46f-4310-9618-b374abd665ec tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:41.952307 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ffb4b80c-b46f-4310-9618-b374abd665ec tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:41.952866 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ffb4b80c-b46f-4310-9618-b374abd665ec tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:42.054526 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f8d474a0-7588-4944-8265-0e96c3e9ee6d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:42.055104 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f8d474a0-7588-4944-8265-0e96c3e9ee6d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:42.064306 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f8d474a0-7588-4944-8265-0e96c3e9ee6d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:42.064784 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f8d474a0-7588-4944-8265-0e96c3e9ee6d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:42.065548 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f8d474a0-7588-4944-8265-0e96c3e9ee6d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:42.065978 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f8d474a0-7588-4944-8265-0e96c3e9ee6d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:42.331095 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ffb4b80c-b46f-4310-9618-b374abd665ec tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:42.340559 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-ffb4b80c-b46f-4310-9618-b374abd665ec tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.404251 Apr 12 00:26:42.341364 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 60/130] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:41 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:42.346328 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-05b3bb64-87e3-4c1c-98bc-4fc6dc3581ca req-66031e33-932c-4455-86f7-6b9ba695e533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6812d1c1-9663-404e-a23f-db9a8dc7e766", "name": "network-vif-plugged", "status": "completed", "tag": "9859cd42-a040-4515-a314-efe078c16231"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:42.354532 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-05b3bb64-87e3-4c1c-98bc-4fc6dc3581ca req-66031e33-932c-4455-86f7-6b9ba695e533 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:42.354968 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-05b3bb64-87e3-4c1c-98bc-4fc6dc3581ca req-66031e33-932c-4455-86f7-6b9ba695e533 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:42.367007 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-05b3bb64-87e3-4c1c-98bc-4fc6dc3581ca req-66031e33-932c-4455-86f7-6b9ba695e533 service nova] Creating event network-vif-plugged:9859cd42-a040-4515-a314-efe078c16231 for instance 6812d1c1-9663-404e-a23f-db9a8dc7e766 on hv-cinder-83625 Apr 12 00:26:42.372153 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-05b3bb64-87e3-4c1c-98bc-4fc6dc3581ca req-66031e33-932c-4455-86f7-6b9ba695e533 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029479 Apr 12 00:26:42.372840 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 61/131] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:26:42.467501 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f8d474a0-7588-4944-8265-0e96c3e9ee6d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:42.475126 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f8d474a0-7588-4944-8265-0e96c3e9ee6d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.424835 Apr 12 00:26:42.475707 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 71/132] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:42 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:43.366052 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c156fd83-1e3b-4e3f-bf0d-da26cfa15227 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:43.366883 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c156fd83-1e3b-4e3f-bf0d-da26cfa15227 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:43.378047 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c156fd83-1e3b-4e3f-bf0d-da26cfa15227 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:43.379241 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c156fd83-1e3b-4e3f-bf0d-da26cfa15227 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:43.385552 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c156fd83-1e3b-4e3f-bf0d-da26cfa15227 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:43.385991 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c156fd83-1e3b-4e3f-bf0d-da26cfa15227 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:43.492846 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e3bbe153-5f3f-4582-8d33-b12c8ffed781 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:43.493464 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e3bbe153-5f3f-4582-8d33-b12c8ffed781 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:43.501901 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e3bbe153-5f3f-4582-8d33-b12c8ffed781 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:43.502350 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e3bbe153-5f3f-4582-8d33-b12c8ffed781 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:43.509485 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e3bbe153-5f3f-4582-8d33-b12c8ffed781 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:43.511524 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e3bbe153-5f3f-4582-8d33-b12c8ffed781 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:43.776913 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c156fd83-1e3b-4e3f-bf0d-da26cfa15227 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:43.786406 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c156fd83-1e3b-4e3f-bf0d-da26cfa15227 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.424819 Apr 12 00:26:43.788533 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 62/133] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:43 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:43.861069 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e3bbe153-5f3f-4582-8d33-b12c8ffed781 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:43.871778 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e3bbe153-5f3f-4582-8d33-b12c8ffed781 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1321 microversion: 2.1 time: 0.383165 Apr 12 00:26:43.873361 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 72/134] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:43 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:44.805256 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-74cc22f9-ea03-4a3e-b9aa-f84813ca0d20 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:44.805989 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-74cc22f9-ea03-4a3e-b9aa-f84813ca0d20 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:44.829323 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-74cc22f9-ea03-4a3e-b9aa-f84813ca0d20 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:44.829908 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-74cc22f9-ea03-4a3e-b9aa-f84813ca0d20 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:44.834822 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-74cc22f9-ea03-4a3e-b9aa-f84813ca0d20 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:44.835359 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-74cc22f9-ea03-4a3e-b9aa-f84813ca0d20 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:44.888899 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8fb7bb78-ad81-4482-9297-18b5d3b720f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:44.892506 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8fb7bb78-ad81-4482-9297-18b5d3b720f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:44.904794 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8fb7bb78-ad81-4482-9297-18b5d3b720f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:44.905249 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8fb7bb78-ad81-4482-9297-18b5d3b720f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:44.910805 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8fb7bb78-ad81-4482-9297-18b5d3b720f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:44.911501 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8fb7bb78-ad81-4482-9297-18b5d3b720f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:45.047182 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-74cc22f9-ea03-4a3e-b9aa-f84813ca0d20 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:45.064427 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-74cc22f9-ea03-4a3e-b9aa-f84813ca0d20 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.263364 Apr 12 00:26:45.065551 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 63/135] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:44 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:45.111907 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8fb7bb78-ad81-4482-9297-18b5d3b720f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:45.120631 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8fb7bb78-ad81-4482-9297-18b5d3b720f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1515 microversion: 2.1 time: 0.235032 Apr 12 00:26:45.121762 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 73/136] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:44 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:45.141042 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-14663d80-586f-4952-894e-f3a28ba9b471 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:45.143075 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-14663d80-586f-4952-894e-f3a28ba9b471 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:45.151592 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-14663d80-586f-4952-894e-f3a28ba9b471 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:45.152043 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-14663d80-586f-4952-894e-f3a28ba9b471 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:45.152816 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-14663d80-586f-4952-894e-f3a28ba9b471 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:45.153544 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-14663d80-586f-4952-894e-f3a28ba9b471 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:45.182503 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-14663d80-586f-4952-894e-f3a28ba9b471 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lazy-loading 'flavor' on Instance uuid 436e51f9-0f9a-4bb2-a03e-b53050e1dc80 {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:26:45.341658 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-14663d80-586f-4952-894e-f3a28ba9b471 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "POST /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80/action" status: 200 len: 32 microversion: 2.1 time: 0.206985 Apr 12 00:26:45.342340 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 64/137] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Apr 12 00:26:45 2022] POST /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80/action => generated 32 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:26:45.352767 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c3d723ab-c7ea-44a7-95eb-425cd825cbcd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:45.353429 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c3d723ab-c7ea-44a7-95eb-425cd825cbcd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:45.359348 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c3d723ab-c7ea-44a7-95eb-425cd825cbcd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:45.359793 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c3d723ab-c7ea-44a7-95eb-425cd825cbcd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:45.360688 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c3d723ab-c7ea-44a7-95eb-425cd825cbcd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:45.361156 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c3d723ab-c7ea-44a7-95eb-425cd825cbcd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:45.513318 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-c3d723ab-c7ea-44a7-95eb-425cd825cbcd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:45.521294 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c3d723ab-c7ea-44a7-95eb-425cd825cbcd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.173921 Apr 12 00:26:45.521949 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 74/138] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:45 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:46.084701 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-944e01c5-768d-4651-b9ab-89b00abd2deb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:46.086605 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-944e01c5-768d-4651-b9ab-89b00abd2deb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:46.094728 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-944e01c5-768d-4651-b9ab-89b00abd2deb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:46.095248 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-944e01c5-768d-4651-b9ab-89b00abd2deb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:46.097279 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-944e01c5-768d-4651-b9ab-89b00abd2deb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:46.098499 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-944e01c5-768d-4651-b9ab-89b00abd2deb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:46.249447 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-944e01c5-768d-4651-b9ab-89b00abd2deb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:46.256767 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-944e01c5-768d-4651-b9ab-89b00abd2deb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.178876 Apr 12 00:26:46.257332 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 65/139] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:46 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:46.538996 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c7688cbe-5548-49ba-819f-f8bcb9c8932c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:46.539600 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c7688cbe-5548-49ba-819f-f8bcb9c8932c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:46.545753 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c7688cbe-5548-49ba-819f-f8bcb9c8932c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:46.546197 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c7688cbe-5548-49ba-819f-f8bcb9c8932c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:46.546985 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c7688cbe-5548-49ba-819f-f8bcb9c8932c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:46.547411 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c7688cbe-5548-49ba-819f-f8bcb9c8932c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:46.672249 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-c7688cbe-5548-49ba-819f-f8bcb9c8932c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:46.680237 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c7688cbe-5548-49ba-819f-f8bcb9c8932c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.145038 Apr 12 00:26:46.680809 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 75/140] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:46 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:47.273989 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-29d26b34-8322-4ce8-81dc-4b3a1f4ff664 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:47.274670 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-29d26b34-8322-4ce8-81dc-4b3a1f4ff664 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:47.280730 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-29d26b34-8322-4ce8-81dc-4b3a1f4ff664 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:47.281177 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-29d26b34-8322-4ce8-81dc-4b3a1f4ff664 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:47.281934 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-29d26b34-8322-4ce8-81dc-4b3a1f4ff664 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:47.282400 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-29d26b34-8322-4ce8-81dc-4b3a1f4ff664 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:47.408012 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-29d26b34-8322-4ce8-81dc-4b3a1f4ff664 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:47.415128 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-29d26b34-8322-4ce8-81dc-4b3a1f4ff664 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.145592 Apr 12 00:26:47.415700 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 66/141] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:47 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:47.698142 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7356b979-f6f7-4bfb-9d8a-5168e645318e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:47.698780 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7356b979-f6f7-4bfb-9d8a-5168e645318e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:47.704956 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7356b979-f6f7-4bfb-9d8a-5168e645318e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:47.705406 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7356b979-f6f7-4bfb-9d8a-5168e645318e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:47.706160 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7356b979-f6f7-4bfb-9d8a-5168e645318e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:47.706663 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7356b979-f6f7-4bfb-9d8a-5168e645318e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:47.826807 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7356b979-f6f7-4bfb-9d8a-5168e645318e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:47.834017 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7356b979-f6f7-4bfb-9d8a-5168e645318e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.140094 Apr 12 00:26:47.834612 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 76/142] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:47 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:48.431692 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2b858f9d-28e6-4bdb-a3b1-6c45e7788aae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:48.432325 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2b858f9d-28e6-4bdb-a3b1-6c45e7788aae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:48.437984 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2b858f9d-28e6-4bdb-a3b1-6c45e7788aae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:48.438456 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2b858f9d-28e6-4bdb-a3b1-6c45e7788aae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:48.439207 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2b858f9d-28e6-4bdb-a3b1-6c45e7788aae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:48.439630 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2b858f9d-28e6-4bdb-a3b1-6c45e7788aae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:48.559823 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2b858f9d-28e6-4bdb-a3b1-6c45e7788aae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:48.567622 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2b858f9d-28e6-4bdb-a3b1-6c45e7788aae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.139648 Apr 12 00:26:48.568183 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 67/143] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:48 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:48.850374 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9cc3abda-bc44-4aec-b08c-cbdf1c5b9b05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:48.851008 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9cc3abda-bc44-4aec-b08c-cbdf1c5b9b05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:48.857256 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9cc3abda-bc44-4aec-b08c-cbdf1c5b9b05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:48.857696 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9cc3abda-bc44-4aec-b08c-cbdf1c5b9b05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:48.858486 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9cc3abda-bc44-4aec-b08c-cbdf1c5b9b05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:48.858914 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9cc3abda-bc44-4aec-b08c-cbdf1c5b9b05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:48.982326 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9cc3abda-bc44-4aec-b08c-cbdf1c5b9b05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:48.990457 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9cc3abda-bc44-4aec-b08c-cbdf1c5b9b05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.144622 Apr 12 00:26:48.991094 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 77/144] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:48 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:49.584832 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e3339f2d-3054-4438-badb-c45e7097132a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:49.585423 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e3339f2d-3054-4438-badb-c45e7097132a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:49.591282 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e3339f2d-3054-4438-badb-c45e7097132a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:49.591718 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e3339f2d-3054-4438-badb-c45e7097132a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:49.592461 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e3339f2d-3054-4438-badb-c45e7097132a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:49.592886 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e3339f2d-3054-4438-badb-c45e7097132a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:49.725676 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e3339f2d-3054-4438-badb-c45e7097132a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:49.733392 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e3339f2d-3054-4438-badb-c45e7097132a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.152725 Apr 12 00:26:49.733965 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 68/145] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:49 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:50.006766 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-338c0da3-c465-45de-ba3f-fbae3b697f8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:50.007419 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-338c0da3-c465-45de-ba3f-fbae3b697f8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:50.013542 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-338c0da3-c465-45de-ba3f-fbae3b697f8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:50.013987 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-338c0da3-c465-45de-ba3f-fbae3b697f8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:50.014767 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-338c0da3-c465-45de-ba3f-fbae3b697f8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:50.015199 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-338c0da3-c465-45de-ba3f-fbae3b697f8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:50.149741 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-338c0da3-c465-45de-ba3f-fbae3b697f8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:50.157252 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-338c0da3-c465-45de-ba3f-fbae3b697f8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.154394 Apr 12 00:26:50.157814 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 78/146] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:50 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:50.750936 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-23790ed8-1381-4da1-b70f-d4bbf4c878b3 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:50.751637 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-23790ed8-1381-4da1-b70f-d4bbf4c878b3 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:50.758223 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-23790ed8-1381-4da1-b70f-d4bbf4c878b3 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:50.759049 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-23790ed8-1381-4da1-b70f-d4bbf4c878b3 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:50.759867 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-23790ed8-1381-4da1-b70f-d4bbf4c878b3 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:50.760385 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-23790ed8-1381-4da1-b70f-d4bbf4c878b3 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:50.885211 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-23790ed8-1381-4da1-b70f-d4bbf4c878b3 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:50.892457 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-23790ed8-1381-4da1-b70f-d4bbf4c878b3 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.145383 Apr 12 00:26:50.893053 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 69/147] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:50 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:51.174104 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-6b3da19c-e5bc-48d6-990b-f64afddaef98 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:51.174767 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-6b3da19c-e5bc-48d6-990b-f64afddaef98 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:51.181698 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6b3da19c-e5bc-48d6-990b-f64afddaef98 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:51.182146 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6b3da19c-e5bc-48d6-990b-f64afddaef98 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:51.183039 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6b3da19c-e5bc-48d6-990b-f64afddaef98 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:51.183476 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6b3da19c-e5bc-48d6-990b-f64afddaef98 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:51.306839 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-6b3da19c-e5bc-48d6-990b-f64afddaef98 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:51.314036 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-6b3da19c-e5bc-48d6-990b-f64afddaef98 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.143835 Apr 12 00:26:51.314630 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 79/148] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:51 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:51.908745 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-0252c3f1-9eb4-4175-add2-6aa546e3bbb7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:51.909343 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-0252c3f1-9eb4-4175-add2-6aa546e3bbb7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:51.915556 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0252c3f1-9eb4-4175-add2-6aa546e3bbb7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:51.915998 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0252c3f1-9eb4-4175-add2-6aa546e3bbb7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:51.916829 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0252c3f1-9eb4-4175-add2-6aa546e3bbb7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:51.917294 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0252c3f1-9eb4-4175-add2-6aa546e3bbb7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:52.044241 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-0252c3f1-9eb4-4175-add2-6aa546e3bbb7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:52.051991 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-0252c3f1-9eb4-4175-add2-6aa546e3bbb7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1363 microversion: 2.1 time: 0.147111 Apr 12 00:26:52.052567 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 70/149] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:51 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:52.329754 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-75c01d0f-2c1c-4e43-9ae5-7c9b87f7b942 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:52.330399 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-75c01d0f-2c1c-4e43-9ae5-7c9b87f7b942 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:52.343545 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-75c01d0f-2c1c-4e43-9ae5-7c9b87f7b942 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:52.344110 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-75c01d0f-2c1c-4e43-9ae5-7c9b87f7b942 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:52.345000 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-75c01d0f-2c1c-4e43-9ae5-7c9b87f7b942 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:52.345506 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-75c01d0f-2c1c-4e43-9ae5-7c9b87f7b942 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:52.483994 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-75c01d0f-2c1c-4e43-9ae5-7c9b87f7b942 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:52.491434 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-75c01d0f-2c1c-4e43-9ae5-7c9b87f7b942 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.165561 Apr 12 00:26:52.492005 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 80/150] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:52 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:53.069977 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-fd1a3f14-33f7-45d8-8594-21a2a3816d6f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:53.070615 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-fd1a3f14-33f7-45d8-8594-21a2a3816d6f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:53.076393 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fd1a3f14-33f7-45d8-8594-21a2a3816d6f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:53.076877 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fd1a3f14-33f7-45d8-8594-21a2a3816d6f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:53.077640 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fd1a3f14-33f7-45d8-8594-21a2a3816d6f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:53.078076 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fd1a3f14-33f7-45d8-8594-21a2a3816d6f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:53.219313 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-fd1a3f14-33f7-45d8-8594-21a2a3816d6f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:53.228568 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-fd1a3f14-33f7-45d8-8594-21a2a3816d6f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1549 microversion: 2.1 time: 0.163699 Apr 12 00:26:53.231604 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 71/151] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:53 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:53.248179 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8561a55c-a24d-41fc-83ef-fb999320a5b5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:53.248673 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8561a55c-a24d-41fc-83ef-fb999320a5b5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:53.254674 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8561a55c-a24d-41fc-83ef-fb999320a5b5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:53.255125 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8561a55c-a24d-41fc-83ef-fb999320a5b5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:53.255888 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8561a55c-a24d-41fc-83ef-fb999320a5b5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:53.256317 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8561a55c-a24d-41fc-83ef-fb999320a5b5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:53.336096 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8561a55c-a24d-41fc-83ef-fb999320a5b5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091703 Apr 12 00:26:53.337297 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 81/152] 10.222.0.32 () {58 vars in 1274 bytes} [Tue Apr 12 00:26:53 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:26:53.512326 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-897453bd-3608-4167-bfe5-2877150c3d0f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:53.513009 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-897453bd-3608-4167-bfe5-2877150c3d0f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:53.519789 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-897453bd-3608-4167-bfe5-2877150c3d0f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:53.520323 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-897453bd-3608-4167-bfe5-2877150c3d0f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:53.521328 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-897453bd-3608-4167-bfe5-2877150c3d0f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:53.521822 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-897453bd-3608-4167-bfe5-2877150c3d0f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:53.674438 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-897453bd-3608-4167-bfe5-2877150c3d0f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:53.692952 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-897453bd-3608-4167-bfe5-2877150c3d0f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.185306 Apr 12 00:26:53.694145 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 72/153] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:53 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:54.532085 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-d5f81d0d-c880-4c67-a0c4-f971dbfccf0d req-1d356c37-a5b0-4fee-9b4f-e465002ab1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6812d1c1-9663-404e-a23f-db9a8dc7e766", "tag": "9859cd42-a040-4515-a314-efe078c16231"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:54.541649 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-d5f81d0d-c880-4c67-a0c4-f971dbfccf0d req-1d356c37-a5b0-4fee-9b4f-e465002ab1e5 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:54.542395 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-d5f81d0d-c880-4c67-a0c4-f971dbfccf0d req-1d356c37-a5b0-4fee-9b4f-e465002ab1e5 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:54.554391 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-d5f81d0d-c880-4c67-a0c4-f971dbfccf0d req-1d356c37-a5b0-4fee-9b4f-e465002ab1e5 service nova] Creating event network-changed:9859cd42-a040-4515-a314-efe078c16231 for instance 6812d1c1-9663-404e-a23f-db9a8dc7e766 on hv-cinder-83625 Apr 12 00:26:54.559442 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-d5f81d0d-c880-4c67-a0c4-f971dbfccf0d req-1d356c37-a5b0-4fee-9b4f-e465002ab1e5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031518 Apr 12 00:26:54.560027 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 82/154] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:26:54.711352 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c4e4a9b6-94ce-4204-b98d-844ebcbfb71c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:54.711998 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c4e4a9b6-94ce-4204-b98d-844ebcbfb71c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:54.727672 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4e4a9b6-94ce-4204-b98d-844ebcbfb71c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:54.728217 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4e4a9b6-94ce-4204-b98d-844ebcbfb71c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:54.728984 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4e4a9b6-94ce-4204-b98d-844ebcbfb71c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:54.729507 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4e4a9b6-94ce-4204-b98d-844ebcbfb71c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:55.100038 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-61416a2e-ed60-46bd-9c89-ef249b0d8b98 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:55.100847 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-61416a2e-ed60-46bd-9c89-ef249b0d8b98 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:55.107709 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-61416a2e-ed60-46bd-9c89-ef249b0d8b98 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:55.108590 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-61416a2e-ed60-46bd-9c89-ef249b0d8b98 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:55.109603 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-61416a2e-ed60-46bd-9c89-ef249b0d8b98 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:55.110347 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-61416a2e-ed60-46bd-9c89-ef249b0d8b98 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:55.147368 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-61416a2e-ed60-46bd-9c89-ef249b0d8b98 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Going to try to terminate instance {{(pid=128486) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:26:55.270053 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-61416a2e-ed60-46bd-9c89-ef249b0d8b98 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "DELETE /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 204 len: 0 microversion: 2.1 time: 0.170254 Apr 12 00:26:55.270708 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 83/155] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:26:55 2022] DELETE /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:26:55.289618 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9d821f74-2d63-42a6-abe9-a07f5323eba0 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:55.289618 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9d821f74-2d63-42a6-abe9-a07f5323eba0 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:55.305832 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c4e4a9b6-94ce-4204-b98d-844ebcbfb71c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:55.314302 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c4e4a9b6-94ce-4204-b98d-844ebcbfb71c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.607270 Apr 12 00:26:55.317658 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9d821f74-2d63-42a6-abe9-a07f5323eba0 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:55.318338 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9d821f74-2d63-42a6-abe9-a07f5323eba0 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:55.321871 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 73/156] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:54 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:55.322921 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9d821f74-2d63-42a6-abe9-a07f5323eba0 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:55.325102 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9d821f74-2d63-42a6-abe9-a07f5323eba0 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:55.482132 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9d821f74-2d63-42a6-abe9-a07f5323eba0 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:55.490523 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9d821f74-2d63-42a6-abe9-a07f5323eba0 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1552 microversion: 2.1 time: 0.215364 Apr 12 00:26:55.500469 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 84/157] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:55 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1552 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:26:56.334224 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1fcedecf-8e95-4e6c-acdc-ccdefaf56f14 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:56.335515 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1fcedecf-8e95-4e6c-acdc-ccdefaf56f14 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:56.344839 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1fcedecf-8e95-4e6c-acdc-ccdefaf56f14 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:56.345885 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1fcedecf-8e95-4e6c-acdc-ccdefaf56f14 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:56.347422 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1fcedecf-8e95-4e6c-acdc-ccdefaf56f14 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:56.348267 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1fcedecf-8e95-4e6c-acdc-ccdefaf56f14 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:56.508951 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a8199235-0653-4cf3-b32a-aa0f3b9de0b7 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:56.509638 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a8199235-0653-4cf3-b32a-aa0f3b9de0b7 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:56.521552 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8199235-0653-4cf3-b32a-aa0f3b9de0b7 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:56.522138 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1fcedecf-8e95-4e6c-acdc-ccdefaf56f14 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:56.522508 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8199235-0653-4cf3-b32a-aa0f3b9de0b7 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:56.523645 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8199235-0653-4cf3-b32a-aa0f3b9de0b7 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:56.524235 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8199235-0653-4cf3-b32a-aa0f3b9de0b7 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:56.533788 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1fcedecf-8e95-4e6c-acdc-ccdefaf56f14 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.204144 Apr 12 00:26:56.536350 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 74/158] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:56 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:56.761163 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a8199235-0653-4cf3-b32a-aa0f3b9de0b7 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:56.769441 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a8199235-0653-4cf3-b32a-aa0f3b9de0b7 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1552 microversion: 2.1 time: 0.264714 Apr 12 00:26:56.770110 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 85/159] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:56 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1552 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:57.554310 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-73cfc66a-346c-408d-9a83-924cd821ec95 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:57.555998 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-73cfc66a-346c-408d-9a83-924cd821ec95 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:57.564866 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-73cfc66a-346c-408d-9a83-924cd821ec95 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:57.565488 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-73cfc66a-346c-408d-9a83-924cd821ec95 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:57.567634 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-73cfc66a-346c-408d-9a83-924cd821ec95 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:57.568695 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-73cfc66a-346c-408d-9a83-924cd821ec95 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:57.741230 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-73cfc66a-346c-408d-9a83-924cd821ec95 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:57.764951 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-73cfc66a-346c-408d-9a83-924cd821ec95 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.212892 Apr 12 00:26:57.765902 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 75/160] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:57 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:57.787591 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b0441da3-b2e2-4303-89d2-0e3a44c23fbb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:57.788207 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b0441da3-b2e2-4303-89d2-0e3a44c23fbb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:57.800408 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b0441da3-b2e2-4303-89d2-0e3a44c23fbb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:57.801612 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b0441da3-b2e2-4303-89d2-0e3a44c23fbb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:57.802580 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b0441da3-b2e2-4303-89d2-0e3a44c23fbb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:57.803459 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b0441da3-b2e2-4303-89d2-0e3a44c23fbb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:57.970817 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b0441da3-b2e2-4303-89d2-0e3a44c23fbb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:57.982979 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b0441da3-b2e2-4303-89d2-0e3a44c23fbb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1552 microversion: 2.1 time: 0.200051 Apr 12 00:26:57.983577 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 86/161] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:57 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1552 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:58.782678 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-ca35ac54-202e-41dc-9513-67fd47296510 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:58.783849 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-ca35ac54-202e-41dc-9513-67fd47296510 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:58.792736 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ca35ac54-202e-41dc-9513-67fd47296510 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:58.793571 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ca35ac54-202e-41dc-9513-67fd47296510 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:58.794770 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ca35ac54-202e-41dc-9513-67fd47296510 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:58.795712 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ca35ac54-202e-41dc-9513-67fd47296510 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:59.000304 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a988a963-1336-4853-8fdd-a9eab6b44df5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:59.000953 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a988a963-1336-4853-8fdd-a9eab6b44df5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:26:59.018086 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a988a963-1336-4853-8fdd-a9eab6b44df5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:59.022511 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a988a963-1336-4853-8fdd-a9eab6b44df5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:59.023515 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a988a963-1336-4853-8fdd-a9eab6b44df5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:59.026532 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a988a963-1336-4853-8fdd-a9eab6b44df5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:59.089840 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ca35ac54-202e-41dc-9513-67fd47296510 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:59.100485 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-ca35ac54-202e-41dc-9513-67fd47296510 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.321878 Apr 12 00:26:59.100674 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a988a963-1336-4853-8fdd-a9eab6b44df5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:26:59.101078 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 76/162] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:58 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:59.109682 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a988a963-1336-4853-8fdd-a9eab6b44df5 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1510 microversion: 2.1 time: 0.113704 Apr 12 00:26:59.110548 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 87/163] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:26:58 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1510 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:59.126760 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-76808422-cdbf-4adb-a0d7-05a36dc4d266 req-399f3008-99bc-4bf5-a781-1373813c1f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514dbc1c-8df0-4bf2-96db-5911d4bdb52c", "name": "network-vif-deleted", "tag": "55aa4bc9-4cd4-41c4-9139-ebefd9425766"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:59.135879 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-76808422-cdbf-4adb-a0d7-05a36dc4d266 req-399f3008-99bc-4bf5-a781-1373813c1f44 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:26:59.136697 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-76808422-cdbf-4adb-a0d7-05a36dc4d266 req-399f3008-99bc-4bf5-a781-1373813c1f44 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:26:59.151151 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-76808422-cdbf-4adb-a0d7-05a36dc4d266 req-399f3008-99bc-4bf5-a781-1373813c1f44 service nova] Creating event network-vif-deleted:55aa4bc9-4cd4-41c4-9139-ebefd9425766 for instance 514dbc1c-8df0-4bf2-96db-5911d4bdb52c on hv-cinder-83625 Apr 12 00:26:59.158394 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-76808422-cdbf-4adb-a0d7-05a36dc4d266 req-399f3008-99bc-4bf5-a781-1373813c1f44 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035266 Apr 12 00:26:59.166576 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 77/164] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:27:00.126192 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a3c9aa36-ece0-4744-a4a0-a8b59935c235 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:00.126941 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a3c9aa36-ece0-4744-a4a0-a8b59935c235 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:00.127530 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2095493a-4875-4991-949e-5c8fcf6731aa tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:00.128854 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2095493a-4875-4991-949e-5c8fcf6731aa tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:00.133996 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a3c9aa36-ece0-4744-a4a0-a8b59935c235 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:00.134549 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a3c9aa36-ece0-4744-a4a0-a8b59935c235 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:00.135058 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2095493a-4875-4991-949e-5c8fcf6731aa tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:00.135370 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a3c9aa36-ece0-4744-a4a0-a8b59935c235 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:00.135488 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2095493a-4875-4991-949e-5c8fcf6731aa tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:00.135746 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a3c9aa36-ece0-4744-a4a0-a8b59935c235 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:00.136278 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2095493a-4875-4991-949e-5c8fcf6731aa tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:00.136880 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2095493a-4875-4991-949e-5c8fcf6731aa tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:00.242749 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2095493a-4875-4991-949e-5c8fcf6731aa tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc08edc0e354ea0b8e41a2d81f3d9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610d0185cf40548de23d406b26a421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:00.250761 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2095493a-4875-4991-949e-5c8fcf6731aa tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 200 len: 1345 microversion: 2.1 time: 0.127475 Apr 12 00:27:00.251348 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 78/165] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:00 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 1345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:00.290934 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a3c9aa36-ece0-4744-a4a0-a8b59935c235 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:00.299636 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a3c9aa36-ece0-4744-a4a0-a8b59935c235 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.186329 Apr 12 00:27:00.300770 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 88/166] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:00 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:01.268536 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1bd10d78-e50d-445d-9285-60e6bf3d4ebb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:01.269238 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1bd10d78-e50d-445d-9285-60e6bf3d4ebb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:01.275017 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1bd10d78-e50d-445d-9285-60e6bf3d4ebb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:01.275795 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1bd10d78-e50d-445d-9285-60e6bf3d4ebb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:01.276622 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1bd10d78-e50d-445d-9285-60e6bf3d4ebb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:01.277118 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1bd10d78-e50d-445d-9285-60e6bf3d4ebb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:01.290063 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-1bd10d78-e50d-445d-9285-60e6bf3d4ebb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] HTTP exception thrown: Instance 514dbc1c-8df0-4bf2-96db-5911d4bdb52c could not be found. Apr 12 00:27:01.290677 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1bd10d78-e50d-445d-9285-60e6bf3d4ebb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Returning 404 to user: Instance 514dbc1c-8df0-4bf2-96db-5911d4bdb52c could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:27:01.291692 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1bd10d78-e50d-445d-9285-60e6bf3d4ebb tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 404 len: 111 microversion: 2.1 time: 0.027018 Apr 12 00:27:01.292225 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 79/167] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:01 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:27:01.326731 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c4631c5a-85ee-489c-8b10-f2f311807f60 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:01.327606 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c4631c5a-85ee-489c-8b10-f2f311807f60 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:01.333678 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c4631c5a-85ee-489c-8b10-f2f311807f60 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:01.334109 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c4631c5a-85ee-489c-8b10-f2f311807f60 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:01.334892 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c4631c5a-85ee-489c-8b10-f2f311807f60 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:01.335322 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c4631c5a-85ee-489c-8b10-f2f311807f60 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:01.400759 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-fbb5e9f8-b437-4043-a79a-59d631664390 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:01.401784 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-fbb5e9f8-b437-4043-a79a-59d631664390 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:01.408977 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fbb5e9f8-b437-4043-a79a-59d631664390 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:01.409949 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fbb5e9f8-b437-4043-a79a-59d631664390 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:01.410997 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fbb5e9f8-b437-4043-a79a-59d631664390 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:01.411358 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fbb5e9f8-b437-4043-a79a-59d631664390 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:01.425142 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-fbb5e9f8-b437-4043-a79a-59d631664390 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] HTTP exception thrown: Instance 514dbc1c-8df0-4bf2-96db-5911d4bdb52c could not be found. Apr 12 00:27:01.430425 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-fbb5e9f8-b437-4043-a79a-59d631664390 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Returning 404 to user: Instance 514dbc1c-8df0-4bf2-96db-5911d4bdb52c could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:27:01.431486 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-fbb5e9f8-b437-4043-a79a-59d631664390 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034949 Apr 12 00:27:01.432137 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 80/168] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:27:01 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:27:01.486538 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-c4631c5a-85ee-489c-8b10-f2f311807f60 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:01.494207 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c4631c5a-85ee-489c-8b10-f2f311807f60 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.180675 Apr 12 00:27:01.495134 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 89/169] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:01 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:02.511712 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1e34112f-a3fb-4219-9b0f-d0f58b4b276d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:02.512300 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1e34112f-a3fb-4219-9b0f-d0f58b4b276d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:02.518186 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1e34112f-a3fb-4219-9b0f-d0f58b4b276d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:02.519410 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1e34112f-a3fb-4219-9b0f-d0f58b4b276d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:02.520292 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1e34112f-a3fb-4219-9b0f-d0f58b4b276d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:02.520957 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1e34112f-a3fb-4219-9b0f-d0f58b4b276d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:02.647320 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-6b469765-e000-4b71-8255-f91c3e14c817 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:02.647880 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-6b469765-e000-4b71-8255-f91c3e14c817 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:02.653970 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6b469765-e000-4b71-8255-f91c3e14c817 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:02.654462 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6b469765-e000-4b71-8255-f91c3e14c817 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:02.660123 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6b469765-e000-4b71-8255-f91c3e14c817 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:02.660123 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6b469765-e000-4b71-8255-f91c3e14c817 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:02.672165 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1e34112f-a3fb-4219-9b0f-d0f58b4b276d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:02.680845 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1e34112f-a3fb-4219-9b0f-d0f58b4b276d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.172909 Apr 12 00:27:02.681426 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 81/170] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:02 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:02.687031 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-6b469765-e000-4b71-8255-f91c3e14c817 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] HTTP exception thrown: Instance 514dbc1c-8df0-4bf2-96db-5911d4bdb52c could not be found. Apr 12 00:27:02.687968 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-6b469765-e000-4b71-8255-f91c3e14c817 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Returning 404 to user: Instance 514dbc1c-8df0-4bf2-96db-5911d4bdb52c could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:27:02.689325 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-6b469765-e000-4b71-8255-f91c3e14c817 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "DELETE /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 404 len: 111 microversion: 2.1 time: 0.046305 Apr 12 00:27:02.690232 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 90/171] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:27:02 2022] DELETE /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:27:02.698633 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d847f2a3-2821-4656-9144-0bb8a3df4026 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:02.699353 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d847f2a3-2821-4656-9144-0bb8a3df4026 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] [instance: 514dbc1c-8df0-4bf2-96db-5911d4bdb52c] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:02.706921 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d847f2a3-2821-4656-9144-0bb8a3df4026 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:02.707694 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d847f2a3-2821-4656-9144-0bb8a3df4026 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:02.708678 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d847f2a3-2821-4656-9144-0bb8a3df4026 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:02.709267 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d847f2a3-2821-4656-9144-0bb8a3df4026 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:02.723287 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-d847f2a3-2821-4656-9144-0bb8a3df4026 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] HTTP exception thrown: Instance 514dbc1c-8df0-4bf2-96db-5911d4bdb52c could not be found. Apr 12 00:27:02.724211 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d847f2a3-2821-4656-9144-0bb8a3df4026 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] Returning 404 to user: Instance 514dbc1c-8df0-4bf2-96db-5911d4bdb52c could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:27:02.725072 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d847f2a3-2821-4656-9144-0bb8a3df4026 tempest-DeleteServersTestJSON-407358756 tempest-DeleteServersTestJSON-407358756-project] 10.222.0.32 "GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c" status: 404 len: 111 microversion: 2.1 time: 0.030220 Apr 12 00:27:02.725623 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 82/172] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:02 2022] GET /compute/v2.1/servers/514dbc1c-8df0-4bf2-96db-5911d4bdb52c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 00:27:03.704797 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0912dd68-73d9-4747-8aa7-bfa1db721078 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:03.706083 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0912dd68-73d9-4747-8aa7-bfa1db721078 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:03.712856 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0912dd68-73d9-4747-8aa7-bfa1db721078 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:03.713297 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0912dd68-73d9-4747-8aa7-bfa1db721078 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:03.714055 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0912dd68-73d9-4747-8aa7-bfa1db721078 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:03.714657 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0912dd68-73d9-4747-8aa7-bfa1db721078 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:03.863324 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0912dd68-73d9-4747-8aa7-bfa1db721078 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:03.870715 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0912dd68-73d9-4747-8aa7-bfa1db721078 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.170089 Apr 12 00:27:03.871485 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 91/173] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:03 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:04.887866 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4df1c92b-d6f6-433a-8fe4-04d9f7e53cbf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:04.889146 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-4df1c92b-d6f6-433a-8fe4-04d9f7e53cbf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:04.896390 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4df1c92b-d6f6-433a-8fe4-04d9f7e53cbf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:04.897093 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4df1c92b-d6f6-433a-8fe4-04d9f7e53cbf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:04.898026 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4df1c92b-d6f6-433a-8fe4-04d9f7e53cbf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:04.898659 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4df1c92b-d6f6-433a-8fe4-04d9f7e53cbf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:05.069713 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-d80aa0d9-360c-4a8d-8133-280a48a1bcfe tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] Action: 'create', calling method: .version_select at 0x7f64e1483550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1323937522", "metadata": {"Type": "work"}}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:27:05.175101 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-4df1c92b-d6f6-433a-8fe4-04d9f7e53cbf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:05.184150 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-4df1c92b-d6f6-433a-8fe4-04d9f7e53cbf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.300041 Apr 12 00:27:05.184920 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 83/174] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:04 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:05.402944 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-d80aa0d9-360c-4a8d-8133-280a48a1bcfe tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.492002 Apr 12 00:27:05.404653 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 92/175] 10.222.0.32 () {60 vars in 1155 bytes} [Tue Apr 12 00:27:04 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 495 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 12 00:27:05.416802 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-df36e3c7-cf45-4d4d-b86f-b7351385ea85 tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] Calling method '.version_select at 0x7f64e1d72790>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:05.475394 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-df36e3c7-cf45-4d4d-b86f-b7351385ea85 tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/99748946-1d08-45c6-b628-271bbec35694" status: 200 len: 353 microversion: 2.1 time: 0.062886 Apr 12 00:27:05.477169 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 84/176] 10.222.0.32 () {58 vars in 1244 bytes} [Tue Apr 12 00:27:05 2022] GET /compute/v2.1/os-volumes/99748946-1d08-45c6-b628-271bbec35694 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:27:06.203394 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-48e6f26a-2101-4b7e-8f7a-da34d6293602 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:06.204108 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-48e6f26a-2101-4b7e-8f7a-da34d6293602 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:06.210513 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48e6f26a-2101-4b7e-8f7a-da34d6293602 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:06.210966 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48e6f26a-2101-4b7e-8f7a-da34d6293602 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:06.211719 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48e6f26a-2101-4b7e-8f7a-da34d6293602 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:06.212146 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48e6f26a-2101-4b7e-8f7a-da34d6293602 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:06.339058 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-48e6f26a-2101-4b7e-8f7a-da34d6293602 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:06.346310 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-48e6f26a-2101-4b7e-8f7a-da34d6293602 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.147147 Apr 12 00:27:06.347458 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 93/177] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:06 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:06.489225 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-23f8e250-907f-4d9b-b968-d587476819df tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] Calling method '.version_select at 0x7f64e25c68b0>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:06.535318 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-23f8e250-907f-4d9b-b968-d587476819df tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/99748946-1d08-45c6-b628-271bbec35694" status: 200 len: 353 microversion: 2.1 time: 0.049941 Apr 12 00:27:06.535917 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 85/178] 10.222.0.32 () {58 vars in 1244 bytes} [Tue Apr 12 00:27:06 2022] GET /compute/v2.1/os-volumes/99748946-1d08-45c6-b628-271bbec35694 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:27:07.365493 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7bec8d4a-b798-422e-bd30-9f3f0c0c6297 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:07.366148 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7bec8d4a-b798-422e-bd30-9f3f0c0c6297 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:07.372701 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7bec8d4a-b798-422e-bd30-9f3f0c0c6297 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:07.373135 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7bec8d4a-b798-422e-bd30-9f3f0c0c6297 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:07.373909 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7bec8d4a-b798-422e-bd30-9f3f0c0c6297 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:07.374367 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7bec8d4a-b798-422e-bd30-9f3f0c0c6297 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:07.502641 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7bec8d4a-b798-422e-bd30-9f3f0c0c6297 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:07.512973 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7bec8d4a-b798-422e-bd30-9f3f0c0c6297 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.151901 Apr 12 00:27:07.513873 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 94/179] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:07 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:07.547644 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-33b3bd63-000a-44df-8690-3e4d1f95797a tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] Calling method '.version_select at 0x7f64e1d5a8b0>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:07.594973 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-33b3bd63-000a-44df-8690-3e4d1f95797a tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/99748946-1d08-45c6-b628-271bbec35694" status: 200 len: 354 microversion: 2.1 time: 0.051022 Apr 12 00:27:07.595612 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 86/180] 10.222.0.32 () {58 vars in 1244 bytes} [Tue Apr 12 00:27:07 2022] GET /compute/v2.1/os-volumes/99748946-1d08-45c6-b628-271bbec35694 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:27:07.607067 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b731442e-3449-47c5-a9ef-5a95c9fa532d tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] Calling method '.version_select at 0x7f64e149a1f0>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:07.659465 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b731442e-3449-47c5-a9ef-5a95c9fa532d tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/99748946-1d08-45c6-b628-271bbec35694" status: 200 len: 354 microversion: 2.1 time: 0.054022 Apr 12 00:27:07.659465 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 95/181] 10.222.0.32 () {58 vars in 1244 bytes} [Tue Apr 12 00:27:07 2022] GET /compute/v2.1/os-volumes/99748946-1d08-45c6-b628-271bbec35694 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:27:07.673509 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-dd2512cc-30f9-4791-b1f4-b724f5a1bc20 tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] Calling method '.version_select at 0x7f64e14ba700>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:07.732112 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-dd2512cc-30f9-4791-b1f4-b724f5a1bc20 tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/99748946-1d08-45c6-b628-271bbec35694" status: 202 len: 0 microversion: 2.1 time: 0.062290 Apr 12 00:27:07.732697 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 87/182] 10.222.0.32 () {58 vars in 1247 bytes} [Tue Apr 12 00:27:07 2022] DELETE /compute/v2.1/os-volumes/99748946-1d08-45c6-b628-271bbec35694 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:27:07.741431 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b5c4ad65-01a3-420c-982b-bf5963ced59d tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] Calling method '.version_select at 0x7f64e14663a0>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:07.786404 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b5c4ad65-01a3-420c-982b-bf5963ced59d tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/99748946-1d08-45c6-b628-271bbec35694" status: 200 len: 353 microversion: 2.1 time: 0.049351 Apr 12 00:27:07.786973 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 96/183] 10.222.0.32 () {58 vars in 1244 bytes} [Tue Apr 12 00:27:07 2022] GET /compute/v2.1/os-volumes/99748946-1d08-45c6-b628-271bbec35694 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:27:08.092456 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c4c44573-f531-4d92-b30e-5717d9e4b7e5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1170883448", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452", "networks": [{"uuid": "56b7f3f4-fbda-4e53-9444-e45c08b83dce"}]}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:27:08.531700 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1058dda7-2178-4285-ae7c-4ee6fbfad815 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:08.532375 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1058dda7-2178-4285-ae7c-4ee6fbfad815 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:08.538878 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1058dda7-2178-4285-ae7c-4ee6fbfad815 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:08.539327 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1058dda7-2178-4285-ae7c-4ee6fbfad815 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:08.540083 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1058dda7-2178-4285-ae7c-4ee6fbfad815 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:08.540523 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1058dda7-2178-4285-ae7c-4ee6fbfad815 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:08.665369 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1058dda7-2178-4285-ae7c-4ee6fbfad815 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:08.672686 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1058dda7-2178-4285-ae7c-4ee6fbfad815 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.145347 Apr 12 00:27:08.673244 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 97/184] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:08 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:08.798877 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5c3f7758-ac8b-4c8f-bc57-88ef53b433df tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] Calling method '.version_select at 0x7f64e13dc9d0>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:08.826314 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-5c3f7758-ac8b-4c8f-bc57-88ef53b433df tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] HTTP exception thrown: Volume 99748946-1d08-45c6-b628-271bbec35694 could not be found. Apr 12 00:27:08.826908 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5c3f7758-ac8b-4c8f-bc57-88ef53b433df tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] Returning 404 to user: Volume 99748946-1d08-45c6-b628-271bbec35694 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:27:08.827916 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5c3f7758-ac8b-4c8f-bc57-88ef53b433df tempest-VolumesGetTestJSON-783014275 tempest-VolumesGetTestJSON-783014275-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/99748946-1d08-45c6-b628-271bbec35694" status: 404 len: 109 microversion: 2.1 time: 0.033030 Apr 12 00:27:08.828463 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 98/185] 10.222.0.32 () {58 vars in 1244 bytes} [Tue Apr 12 00:27:08 2022] GET /compute/v2.1/os-volumes/99748946-1d08-45c6-b628-271bbec35694 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 00:27:09.690306 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9b4d71c5-8ae7-4746-a9bd-bf372e4248dc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:09.691669 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9b4d71c5-8ae7-4746-a9bd-bf372e4248dc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:09.700029 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9b4d71c5-8ae7-4746-a9bd-bf372e4248dc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:09.700029 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9b4d71c5-8ae7-4746-a9bd-bf372e4248dc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:09.700029 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9b4d71c5-8ae7-4746-a9bd-bf372e4248dc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:09.700029 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9b4d71c5-8ae7-4746-a9bd-bf372e4248dc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:09.837044 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9b4d71c5-8ae7-4746-a9bd-bf372e4248dc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:09.847478 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9b4d71c5-8ae7-4746-a9bd-bf372e4248dc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.159239 Apr 12 00:27:09.852580 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 99/186] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:09 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:10.863202 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-84724506-8edb-4c25-958f-c7ad99d382e0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:10.863850 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-84724506-8edb-4c25-958f-c7ad99d382e0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:10.870108 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-84724506-8edb-4c25-958f-c7ad99d382e0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:10.870601 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-84724506-8edb-4c25-958f-c7ad99d382e0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:10.871599 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-84724506-8edb-4c25-958f-c7ad99d382e0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:10.872037 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-84724506-8edb-4c25-958f-c7ad99d382e0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:11.077295 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-84724506-8edb-4c25-958f-c7ad99d382e0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:11.086940 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-84724506-8edb-4c25-958f-c7ad99d382e0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.228728 Apr 12 00:27:11.087618 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 100/187] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:10 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:11.791408 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.network.neutron [None req-c4c44573-f531-4d92-b30e-5717d9e4b7e5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] validate_networks() for [('56b7f3f4-fbda-4e53-9444-e45c08b83dce', None, None, None, None, None)] {{(pid=128487) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:27:12.106608 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-292a2ae8-e6d6-4baa-8645-2ce69fc8dd75 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:12.111388 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-292a2ae8-e6d6-4baa-8645-2ce69fc8dd75 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:12.121233 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-292a2ae8-e6d6-4baa-8645-2ce69fc8dd75 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:12.121900 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-292a2ae8-e6d6-4baa-8645-2ce69fc8dd75 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:12.123512 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-292a2ae8-e6d6-4baa-8645-2ce69fc8dd75 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:12.124787 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-292a2ae8-e6d6-4baa-8645-2ce69fc8dd75 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:12.172404 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-c4c44573-f531-4d92-b30e-5717d9e4b7e5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Flavor limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:27:12.172857 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-c4c44573-f531-4d92-b30e-5717d9e4b7e5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Image limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:27:12.173332 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-c4c44573-f531-4d92-b30e-5717d9e4b7e5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Flavor pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:27:12.173790 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-c4c44573-f531-4d92-b30e-5717d9e4b7e5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Image pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:27:12.174331 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-c4c44573-f531-4d92-b30e-5717d9e4b7e5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:27:12.200924 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4c44573-f531-4d92-b30e-5717d9e4b7e5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:12.201375 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4c44573-f531-4d92-b30e-5717d9e4b7e5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:12.202180 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4c44573-f531-4d92-b30e-5717d9e4b7e5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:12.202663 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4c44573-f531-4d92-b30e-5717d9e4b7e5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:12.235260 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-c4c44573-f531-4d92-b30e-5717d9e4b7e5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Getting quotas for project 4d829832a67942c89c33adf4eea0df20. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:27:12.240375 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-c4c44573-f531-4d92-b30e-5717d9e4b7e5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Getting quotas for user d01c35b046284938a73d4404234c1f24 and project 4d829832a67942c89c33adf4eea0df20. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:27:12.254153 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c4c44573-f531-4d92-b30e-5717d9e4b7e5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Going to run 1 instances... {{(pid=128487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:27:12.256173 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c4c44573-f531-4d92-b30e-5717d9e4b7e5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:27:12.310496 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c4c44573-f531-4d92-b30e-5717d9e4b7e5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.221723 Apr 12 00:27:12.311698 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 88/188] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:27:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 4224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:27:12.325296 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a46172a2-b45c-4b31-9e77-ea319074618e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:12.328354 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a46172a2-b45c-4b31-9e77-ea319074618e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:12.331474 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-292a2ae8-e6d6-4baa-8645-2ce69fc8dd75 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:12.344298 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-292a2ae8-e6d6-4baa-8645-2ce69fc8dd75 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.242192 Apr 12 00:27:12.345082 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 101/189] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:12 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:12.397145 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a46172a2-b45c-4b31-9e77-ea319074618e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:12.406189 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a46172a2-b45c-4b31-9e77-ea319074618e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1219 microversion: 2.1 time: 0.088618 Apr 12 00:27:12.406786 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 89/190] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:12 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:13.364477 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8995f50c-4cc1-4679-bc3d-56cd0da09857 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:13.365088 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8995f50c-4cc1-4679-bc3d-56cd0da09857 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:13.371763 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8995f50c-4cc1-4679-bc3d-56cd0da09857 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:13.372218 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8995f50c-4cc1-4679-bc3d-56cd0da09857 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:13.372990 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8995f50c-4cc1-4679-bc3d-56cd0da09857 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:13.373430 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8995f50c-4cc1-4679-bc3d-56cd0da09857 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:13.424217 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b67e5591-9f0a-422b-acbf-c9b687b854e6 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:13.425054 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b67e5591-9f0a-422b-acbf-c9b687b854e6 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:13.433122 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b67e5591-9f0a-422b-acbf-c9b687b854e6 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:13.433805 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b67e5591-9f0a-422b-acbf-c9b687b854e6 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:13.434577 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b67e5591-9f0a-422b-acbf-c9b687b854e6 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:13.435002 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b67e5591-9f0a-422b-acbf-c9b687b854e6 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:13.528778 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8995f50c-4cc1-4679-bc3d-56cd0da09857 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:13.531227 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b67e5591-9f0a-422b-acbf-c9b687b854e6 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:13.540638 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b67e5591-9f0a-422b-acbf-c9b687b854e6 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1271 microversion: 2.1 time: 0.121171 Apr 12 00:27:13.541219 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 90/191] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:13 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:13.545716 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8995f50c-4cc1-4679-bc3d-56cd0da09857 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.181796 Apr 12 00:27:13.545716 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 102/192] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:13 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:14.557200 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-fcb48f8b-3e9a-4cd3-834a-b930ba2ffeff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:14.558838 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-fcb48f8b-3e9a-4cd3-834a-b930ba2ffeff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:14.563371 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4226a78b-581a-4dbe-a202-fedf3ca5171f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:14.563987 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4226a78b-581a-4dbe-a202-fedf3ca5171f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:14.566180 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fcb48f8b-3e9a-4cd3-834a-b930ba2ffeff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:14.566898 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fcb48f8b-3e9a-4cd3-834a-b930ba2ffeff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:14.567893 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fcb48f8b-3e9a-4cd3-834a-b930ba2ffeff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:14.568551 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fcb48f8b-3e9a-4cd3-834a-b930ba2ffeff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:14.581236 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4226a78b-581a-4dbe-a202-fedf3ca5171f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:14.581236 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4226a78b-581a-4dbe-a202-fedf3ca5171f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:14.581236 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4226a78b-581a-4dbe-a202-fedf3ca5171f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:14.581236 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4226a78b-581a-4dbe-a202-fedf3ca5171f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:14.805475 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4226a78b-581a-4dbe-a202-fedf3ca5171f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:14.822709 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-fcb48f8b-3e9a-4cd3-834a-b930ba2ffeff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:14.835779 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-fcb48f8b-3e9a-4cd3-834a-b930ba2ffeff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.282048 Apr 12 00:27:14.836682 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 91/193] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:14 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:14.841982 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4226a78b-581a-4dbe-a202-fedf3ca5171f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.278063 Apr 12 00:27:14.847551 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 103/194] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:14 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:15.447121 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-692f769b-f5bf-47b1-a667-6f438d136afb req-6b8451fc-88c0-4fab-a8c1-02b9a33dd7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6443b855-1525-4e40-bfa0-a16e1c2de983", "tag": "031c6bd4-83ae-48dd-b676-61131c7d8178"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:27:15.460983 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-692f769b-f5bf-47b1-a667-6f438d136afb req-6b8451fc-88c0-4fab-a8c1-02b9a33dd7a1 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:15.461423 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-692f769b-f5bf-47b1-a667-6f438d136afb req-6b8451fc-88c0-4fab-a8c1-02b9a33dd7a1 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:15.479232 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-692f769b-f5bf-47b1-a667-6f438d136afb req-6b8451fc-88c0-4fab-a8c1-02b9a33dd7a1 service nova] Creating event network-changed:031c6bd4-83ae-48dd-b676-61131c7d8178 for instance 6443b855-1525-4e40-bfa0-a16e1c2de983 on hv-cinder-83625 Apr 12 00:27:15.484549 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-692f769b-f5bf-47b1-a667-6f438d136afb req-6b8451fc-88c0-4fab-a8c1-02b9a33dd7a1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040928 Apr 12 00:27:15.485941 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 92/195] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:27:15.852875 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ad7d2225-9749-4b8b-951d-70e640d164ec tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:15.853485 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ad7d2225-9749-4b8b-951d-70e640d164ec tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:15.861463 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ad7d2225-9749-4b8b-951d-70e640d164ec tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:15.861955 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ad7d2225-9749-4b8b-951d-70e640d164ec tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:15.863558 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ad7d2225-9749-4b8b-951d-70e640d164ec tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:15.864003 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ad7d2225-9749-4b8b-951d-70e640d164ec tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:15.865679 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-fe59d5cd-f3b4-4674-82cd-cafa10819bca tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:15.866941 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-fe59d5cd-f3b4-4674-82cd-cafa10819bca tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:15.883404 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fe59d5cd-f3b4-4674-82cd-cafa10819bca tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:15.883885 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fe59d5cd-f3b4-4674-82cd-cafa10819bca tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:15.884651 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fe59d5cd-f3b4-4674-82cd-cafa10819bca tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:15.885188 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fe59d5cd-f3b4-4674-82cd-cafa10819bca tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:16.012099 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ad7d2225-9749-4b8b-951d-70e640d164ec tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:16.020931 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ad7d2225-9749-4b8b-951d-70e640d164ec tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.171928 Apr 12 00:27:16.021574 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 104/196] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:15 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:16.123499 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-fe59d5cd-f3b4-4674-82cd-cafa10819bca tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:16.131610 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-fe59d5cd-f3b4-4674-82cd-cafa10819bca tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.273015 Apr 12 00:27:16.132262 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 93/197] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:15 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:17.038224 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-6653db0b-fff2-470a-adda-41304561041c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:17.038858 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-6653db0b-fff2-470a-adda-41304561041c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:17.045071 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6653db0b-fff2-470a-adda-41304561041c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:17.045563 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6653db0b-fff2-470a-adda-41304561041c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:17.046345 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6653db0b-fff2-470a-adda-41304561041c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:17.046796 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6653db0b-fff2-470a-adda-41304561041c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:17.148499 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5cea9169-4fcc-4484-b284-a22cb57ec387 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:17.149939 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5cea9169-4fcc-4484-b284-a22cb57ec387 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:17.156987 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5cea9169-4fcc-4484-b284-a22cb57ec387 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:17.157517 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5cea9169-4fcc-4484-b284-a22cb57ec387 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:17.158457 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5cea9169-4fcc-4484-b284-a22cb57ec387 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:17.159572 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5cea9169-4fcc-4484-b284-a22cb57ec387 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:17.180605 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-6653db0b-fff2-470a-adda-41304561041c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:17.188008 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-6653db0b-fff2-470a-adda-41304561041c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.153602 Apr 12 00:27:17.188578 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 105/198] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:17 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:17.294582 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-5cea9169-4fcc-4484-b284-a22cb57ec387 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:17.301763 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5cea9169-4fcc-4484-b284-a22cb57ec387 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.157429 Apr 12 00:27:17.302344 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 94/199] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:17 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:17.831149 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-10e6b0a3-129c-42bd-a076-f6c5d9d66e62 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1909573049", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452", "networks": [{"uuid": "2b113919-fa22-480a-8455-7a7b46c22169"}]}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:27:17.881067 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.network.neutron [None req-10e6b0a3-129c-42bd-a076-f6c5d9d66e62 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] validate_networks() for [('2b113919-fa22-480a-8455-7a7b46c22169', None, None, None, None, None)] {{(pid=128486) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:27:18.205588 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-995d7101-a4b0-4c76-acb9-c00f360f05d5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:18.206113 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-995d7101-a4b0-4c76-acb9-c00f360f05d5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:18.212002 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-995d7101-a4b0-4c76-acb9-c00f360f05d5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:18.212451 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-995d7101-a4b0-4c76-acb9-c00f360f05d5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:18.213211 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-995d7101-a4b0-4c76-acb9-c00f360f05d5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:18.213648 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-995d7101-a4b0-4c76-acb9-c00f360f05d5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:18.224451 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-10e6b0a3-129c-42bd-a076-f6c5d9d66e62 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Flavor limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:27:18.224896 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-10e6b0a3-129c-42bd-a076-f6c5d9d66e62 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Image limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:27:18.225323 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-10e6b0a3-129c-42bd-a076-f6c5d9d66e62 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Flavor pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:27:18.225839 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-10e6b0a3-129c-42bd-a076-f6c5d9d66e62 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Image pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:27:18.226264 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-10e6b0a3-129c-42bd-a076-f6c5d9d66e62 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:27:18.235478 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-10e6b0a3-129c-42bd-a076-f6c5d9d66e62 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:18.235838 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-10e6b0a3-129c-42bd-a076-f6c5d9d66e62 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:18.236621 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-10e6b0a3-129c-42bd-a076-f6c5d9d66e62 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:18.237687 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-10e6b0a3-129c-42bd-a076-f6c5d9d66e62 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:18.253706 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-10e6b0a3-129c-42bd-a076-f6c5d9d66e62 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Getting quotas for project c67b239e9580469aaa5714c21a4c590d. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:27:18.257577 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-10e6b0a3-129c-42bd-a076-f6c5d9d66e62 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Getting quotas for user f1db4aee3a4d43ccb111eb7ede0510d9 and project c67b239e9580469aaa5714c21a4c590d. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:27:18.268733 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-10e6b0a3-129c-42bd-a076-f6c5d9d66e62 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Going to run 1 instances... {{(pid=128486) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:27:18.270996 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-10e6b0a3-129c-42bd-a076-f6c5d9d66e62 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:27:18.319810 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-10e6b0a3-129c-42bd-a076-f6c5d9d66e62 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492905 Apr 12 00:27:18.320897 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 106/200] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:27:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:27:18.325576 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-d1cb3f59-41de-45dc-8cb6-0d0874916f58 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:18.326401 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-d1cb3f59-41de-45dc-8cb6-0d0874916f58 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:18.333073 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d1cb3f59-41de-45dc-8cb6-0d0874916f58 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:18.333530 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d1cb3f59-41de-45dc-8cb6-0d0874916f58 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:18.334334 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d1cb3f59-41de-45dc-8cb6-0d0874916f58 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:18.334780 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d1cb3f59-41de-45dc-8cb6-0d0874916f58 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:18.350786 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-995d7101-a4b0-4c76-acb9-c00f360f05d5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:18.358492 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-995d7101-a4b0-4c76-acb9-c00f360f05d5 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.156761 Apr 12 00:27:18.367831 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 95/201] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:18 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:18.372488 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b48c611b-c435-45c7-b4f4-01faa5726c82 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:18.373087 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b48c611b-c435-45c7-b4f4-01faa5726c82 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:18.436914 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b48c611b-c435-45c7-b4f4-01faa5726c82 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:18.443716 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b48c611b-c435-45c7-b4f4-01faa5726c82 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1214 microversion: 2.1 time: 0.074830 Apr 12 00:27:18.444283 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 96/202] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:18 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:18.469573 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-d1cb3f59-41de-45dc-8cb6-0d0874916f58 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:18.477205 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-d1cb3f59-41de-45dc-8cb6-0d0874916f58 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.155168 Apr 12 00:27:18.477784 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 107/203] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:18 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:19.375257 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a76b97c2-4565-4e70-bf56-62996ccdd8eb tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:19.375767 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a76b97c2-4565-4e70-bf56-62996ccdd8eb tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:19.381647 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a76b97c2-4565-4e70-bf56-62996ccdd8eb tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:19.382097 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a76b97c2-4565-4e70-bf56-62996ccdd8eb tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:19.382956 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a76b97c2-4565-4e70-bf56-62996ccdd8eb tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:19.383414 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a76b97c2-4565-4e70-bf56-62996ccdd8eb tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:19.460603 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2ad15383-83ad-4fca-a2f7-0b768e2b3a75 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:19.461538 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-2ad15383-83ad-4fca-a2f7-0b768e2b3a75 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:19.467463 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2ad15383-83ad-4fca-a2f7-0b768e2b3a75 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:19.467947 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2ad15383-83ad-4fca-a2f7-0b768e2b3a75 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:19.468718 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2ad15383-83ad-4fca-a2f7-0b768e2b3a75 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:19.469157 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2ad15383-83ad-4fca-a2f7-0b768e2b3a75 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:19.511491 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a76b97c2-4565-4e70-bf56-62996ccdd8eb tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:19.518676 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a76b97c2-4565-4e70-bf56-62996ccdd8eb tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.147284 Apr 12 00:27:19.519256 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 97/204] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:19 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:19.523582 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9d2794d5-ca54-4988-8e50-318b171cdf48 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:19.524183 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-9d2794d5-ca54-4988-8e50-318b171cdf48 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:19.531372 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9d2794d5-ca54-4988-8e50-318b171cdf48 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:19.531673 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2ad15383-83ad-4fca-a2f7-0b768e2b3a75 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:19.531809 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9d2794d5-ca54-4988-8e50-318b171cdf48 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:19.532577 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9d2794d5-ca54-4988-8e50-318b171cdf48 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:19.533015 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9d2794d5-ca54-4988-8e50-318b171cdf48 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:19.539925 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2ad15383-83ad-4fca-a2f7-0b768e2b3a75 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1218 microversion: 2.1 time: 0.083120 Apr 12 00:27:19.540748 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 108/205] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:19 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:19.672036 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9d2794d5-ca54-4988-8e50-318b171cdf48 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:19.680090 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9d2794d5-ca54-4988-8e50-318b171cdf48 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.159874 Apr 12 00:27:19.680813 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 98/206] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:19 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:20.536521 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-82260421-4f7a-41f9-acb4-4f0c669a430b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:20.537037 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-82260421-4f7a-41f9-acb4-4f0c669a430b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:20.543259 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-82260421-4f7a-41f9-acb4-4f0c669a430b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:20.543733 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-82260421-4f7a-41f9-acb4-4f0c669a430b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:20.544494 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-82260421-4f7a-41f9-acb4-4f0c669a430b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:20.544933 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-82260421-4f7a-41f9-acb4-4f0c669a430b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:20.556729 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-686f52fa-84cb-46c7-ba6e-f0f9f2b4cb95 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:20.557681 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-686f52fa-84cb-46c7-ba6e-f0f9f2b4cb95 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:20.563436 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-686f52fa-84cb-46c7-ba6e-f0f9f2b4cb95 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:20.563872 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-686f52fa-84cb-46c7-ba6e-f0f9f2b4cb95 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:20.564822 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-686f52fa-84cb-46c7-ba6e-f0f9f2b4cb95 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:20.565356 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-686f52fa-84cb-46c7-ba6e-f0f9f2b4cb95 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:20.626302 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-686f52fa-84cb-46c7-ba6e-f0f9f2b4cb95 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:20.633624 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-686f52fa-84cb-46c7-ba6e-f0f9f2b4cb95 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1266 microversion: 2.1 time: 0.080595 Apr 12 00:27:20.634203 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 99/207] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:20 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:20.671278 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-82260421-4f7a-41f9-acb4-4f0c669a430b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:20.680234 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-82260421-4f7a-41f9-acb4-4f0c669a430b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.148257 Apr 12 00:27:20.680806 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 109/208] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:20 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:20.696856 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-352b0249-9cf9-40b8-8deb-911e1d8edbb5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:20.697460 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-352b0249-9cf9-40b8-8deb-911e1d8edbb5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:20.703278 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-352b0249-9cf9-40b8-8deb-911e1d8edbb5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:20.703729 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-352b0249-9cf9-40b8-8deb-911e1d8edbb5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:20.704489 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-352b0249-9cf9-40b8-8deb-911e1d8edbb5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:20.704925 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-352b0249-9cf9-40b8-8deb-911e1d8edbb5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:20.831990 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-352b0249-9cf9-40b8-8deb-911e1d8edbb5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:20.839291 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-352b0249-9cf9-40b8-8deb-911e1d8edbb5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.146216 Apr 12 00:27:20.839900 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 100/209] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:20 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:21.651440 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-57d8b9a5-41d1-4559-9839-1afe58742544 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:21.652050 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-57d8b9a5-41d1-4559-9839-1afe58742544 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:21.658979 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-57d8b9a5-41d1-4559-9839-1afe58742544 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:21.659441 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-57d8b9a5-41d1-4559-9839-1afe58742544 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:21.660199 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-57d8b9a5-41d1-4559-9839-1afe58742544 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:21.660631 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-57d8b9a5-41d1-4559-9839-1afe58742544 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:21.696804 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-8910d77a-51be-4be7-ad74-4582d96c405b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:21.697411 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-8910d77a-51be-4be7-ad74-4582d96c405b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:21.703353 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8910d77a-51be-4be7-ad74-4582d96c405b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:21.703805 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8910d77a-51be-4be7-ad74-4582d96c405b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:21.704564 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8910d77a-51be-4be7-ad74-4582d96c405b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:21.704998 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8910d77a-51be-4be7-ad74-4582d96c405b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:21.723542 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-57d8b9a5-41d1-4559-9839-1afe58742544 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:21.731747 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-57d8b9a5-41d1-4559-9839-1afe58742544 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1266 microversion: 2.1 time: 0.084334 Apr 12 00:27:21.741761 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 110/210] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:21 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:21.833490 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-8910d77a-51be-4be7-ad74-4582d96c405b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:21.840797 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-8910d77a-51be-4be7-ad74-4582d96c405b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.147823 Apr 12 00:27:21.841393 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 101/211] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:21 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:21.856865 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-d1dae70a-afd3-47ec-abf8-9cd3dbcc824d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:21.857552 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-d1dae70a-afd3-47ec-abf8-9cd3dbcc824d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:21.863893 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d1dae70a-afd3-47ec-abf8-9cd3dbcc824d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:21.864422 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d1dae70a-afd3-47ec-abf8-9cd3dbcc824d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:21.865369 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d1dae70a-afd3-47ec-abf8-9cd3dbcc824d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:21.865809 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d1dae70a-afd3-47ec-abf8-9cd3dbcc824d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:21.996328 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-d1dae70a-afd3-47ec-abf8-9cd3dbcc824d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:22.003751 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-d1dae70a-afd3-47ec-abf8-9cd3dbcc824d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.150931 Apr 12 00:27:22.004325 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 111/212] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:21 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:22.748168 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f2b27bb6-1cab-4d01-9924-d039f5e648a1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:22.748782 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f2b27bb6-1cab-4d01-9924-d039f5e648a1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:22.755357 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2b27bb6-1cab-4d01-9924-d039f5e648a1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:22.755832 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2b27bb6-1cab-4d01-9924-d039f5e648a1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:22.756621 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2b27bb6-1cab-4d01-9924-d039f5e648a1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:22.757055 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2b27bb6-1cab-4d01-9924-d039f5e648a1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:22.815846 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f2b27bb6-1cab-4d01-9924-d039f5e648a1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:22.823166 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f2b27bb6-1cab-4d01-9924-d039f5e648a1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1266 microversion: 2.1 time: 0.078830 Apr 12 00:27:22.823739 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 102/213] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:22 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:22.856853 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-31580d15-5716-40e5-baf4-196e201f586e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:22.857469 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-31580d15-5716-40e5-baf4-196e201f586e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:22.864256 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-31580d15-5716-40e5-baf4-196e201f586e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:22.864709 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-31580d15-5716-40e5-baf4-196e201f586e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:22.865477 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-31580d15-5716-40e5-baf4-196e201f586e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:22.865915 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-31580d15-5716-40e5-baf4-196e201f586e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:22.989806 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-31580d15-5716-40e5-baf4-196e201f586e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:22.997197 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-31580d15-5716-40e5-baf4-196e201f586e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.144266 Apr 12 00:27:22.997802 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 112/214] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:22 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:23.020282 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a4f36eb0-f967-40e7-8de5-856be5b25926 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:23.020891 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a4f36eb0-f967-40e7-8de5-856be5b25926 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:23.026905 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a4f36eb0-f967-40e7-8de5-856be5b25926 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:23.027353 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a4f36eb0-f967-40e7-8de5-856be5b25926 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:23.028105 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a4f36eb0-f967-40e7-8de5-856be5b25926 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:23.028540 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a4f36eb0-f967-40e7-8de5-856be5b25926 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:23.150596 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a4f36eb0-f967-40e7-8de5-856be5b25926 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:23.157816 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a4f36eb0-f967-40e7-8de5-856be5b25926 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.141297 Apr 12 00:27:23.158926 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 103/215] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:23 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:23.839181 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c5c78cb3-6a36-4567-845f-2355fcd223ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:23.839797 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c5c78cb3-6a36-4567-845f-2355fcd223ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:23.848567 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c5c78cb3-6a36-4567-845f-2355fcd223ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:23.849024 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c5c78cb3-6a36-4567-845f-2355fcd223ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:23.850143 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c5c78cb3-6a36-4567-845f-2355fcd223ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:23.850240 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c5c78cb3-6a36-4567-845f-2355fcd223ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:23.914110 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-c5c78cb3-6a36-4567-845f-2355fcd223ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:23.921431 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c5c78cb3-6a36-4567-845f-2355fcd223ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1266 microversion: 2.1 time: 0.085785 Apr 12 00:27:23.922094 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 113/216] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:23 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:24.014525 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f564a863-f87b-458d-b26d-5e3b604853bc tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:24.015162 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f564a863-f87b-458d-b26d-5e3b604853bc tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:24.020883 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f564a863-f87b-458d-b26d-5e3b604853bc tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:24.021334 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f564a863-f87b-458d-b26d-5e3b604853bc tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:24.022139 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f564a863-f87b-458d-b26d-5e3b604853bc tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:24.022605 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f564a863-f87b-458d-b26d-5e3b604853bc tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:24.145425 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f564a863-f87b-458d-b26d-5e3b604853bc tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:24.152880 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f564a863-f87b-458d-b26d-5e3b604853bc tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.142141 Apr 12 00:27:24.153445 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 104/217] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:24 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:24.175122 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7064c1df-8499-4dd3-864c-63990b334950 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:24.175684 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7064c1df-8499-4dd3-864c-63990b334950 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:24.181393 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7064c1df-8499-4dd3-864c-63990b334950 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:24.181836 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7064c1df-8499-4dd3-864c-63990b334950 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:24.182611 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7064c1df-8499-4dd3-864c-63990b334950 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:24.183038 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7064c1df-8499-4dd3-864c-63990b334950 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:24.309912 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7064c1df-8499-4dd3-864c-63990b334950 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:24.317929 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7064c1df-8499-4dd3-864c-63990b334950 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.146600 Apr 12 00:27:24.318535 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 114/218] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:24 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:24.938136 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c9caeed3-fb87-481a-8b2a-24a18aa36c2d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:24.938779 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c9caeed3-fb87-481a-8b2a-24a18aa36c2d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:24.944697 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c9caeed3-fb87-481a-8b2a-24a18aa36c2d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:24.945150 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c9caeed3-fb87-481a-8b2a-24a18aa36c2d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:24.945920 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c9caeed3-fb87-481a-8b2a-24a18aa36c2d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:24.946370 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c9caeed3-fb87-481a-8b2a-24a18aa36c2d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:25.005000 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c9caeed3-fb87-481a-8b2a-24a18aa36c2d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:25.012044 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c9caeed3-fb87-481a-8b2a-24a18aa36c2d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1266 microversion: 2.1 time: 0.077684 Apr 12 00:27:25.012602 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 105/219] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:24 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:25.169429 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-810b8341-d331-4de9-bf07-15fa2927045b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:25.170042 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-810b8341-d331-4de9-bf07-15fa2927045b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:25.176498 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-810b8341-d331-4de9-bf07-15fa2927045b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:25.176971 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-810b8341-d331-4de9-bf07-15fa2927045b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:25.177784 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-810b8341-d331-4de9-bf07-15fa2927045b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:25.178226 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-810b8341-d331-4de9-bf07-15fa2927045b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:25.302277 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-810b8341-d331-4de9-bf07-15fa2927045b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:25.309569 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-810b8341-d331-4de9-bf07-15fa2927045b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.143923 Apr 12 00:27:25.310137 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 115/220] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:25 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:25.334972 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f643ec62-8a3c-4306-b45f-f87ec3e8a1a9 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:25.335601 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f643ec62-8a3c-4306-b45f-f87ec3e8a1a9 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:25.341353 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f643ec62-8a3c-4306-b45f-f87ec3e8a1a9 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:25.341802 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f643ec62-8a3c-4306-b45f-f87ec3e8a1a9 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:25.342590 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f643ec62-8a3c-4306-b45f-f87ec3e8a1a9 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:25.343023 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f643ec62-8a3c-4306-b45f-f87ec3e8a1a9 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:25.547177 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f643ec62-8a3c-4306-b45f-f87ec3e8a1a9 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:25.555101 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f643ec62-8a3c-4306-b45f-f87ec3e8a1a9 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.223897 Apr 12 00:27:25.555673 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 106/221] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:25 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:26.029277 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-298ede30-7f75-4e3d-8b53-ae40a7cf3acb tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:26.029907 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-298ede30-7f75-4e3d-8b53-ae40a7cf3acb tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:26.036139 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-298ede30-7f75-4e3d-8b53-ae40a7cf3acb tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:26.036592 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-298ede30-7f75-4e3d-8b53-ae40a7cf3acb tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:26.037353 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-298ede30-7f75-4e3d-8b53-ae40a7cf3acb tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:26.037781 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-298ede30-7f75-4e3d-8b53-ae40a7cf3acb tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:26.101024 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-298ede30-7f75-4e3d-8b53-ae40a7cf3acb tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:26.108395 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-298ede30-7f75-4e3d-8b53-ae40a7cf3acb tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1272 microversion: 2.1 time: 0.083456 Apr 12 00:27:26.118896 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 116/222] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:26 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:26.329789 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-bc8eafb1-101d-4922-bef2-e0d29e1dd6ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:26.331015 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-bc8eafb1-101d-4922-bef2-e0d29e1dd6ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:26.336773 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bc8eafb1-101d-4922-bef2-e0d29e1dd6ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:26.337346 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bc8eafb1-101d-4922-bef2-e0d29e1dd6ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:26.337945 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bc8eafb1-101d-4922-bef2-e0d29e1dd6ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:26.338400 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bc8eafb1-101d-4922-bef2-e0d29e1dd6ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:26.570976 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1f152089-61fa-4125-a77a-39464eb28cbf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:26.571575 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1f152089-61fa-4125-a77a-39464eb28cbf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:26.578130 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1f152089-61fa-4125-a77a-39464eb28cbf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:26.578640 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1f152089-61fa-4125-a77a-39464eb28cbf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:26.579413 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1f152089-61fa-4125-a77a-39464eb28cbf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:26.579846 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1f152089-61fa-4125-a77a-39464eb28cbf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:26.712199 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1f152089-61fa-4125-a77a-39464eb28cbf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:26.719591 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1f152089-61fa-4125-a77a-39464eb28cbf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.152464 Apr 12 00:27:26.720240 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 117/223] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:26 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:26.742792 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-bc8eafb1-101d-4922-bef2-e0d29e1dd6ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:26.749999 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-bc8eafb1-101d-4922-bef2-e0d29e1dd6ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.423934 Apr 12 00:27:26.750599 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 107/224] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:26 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:26.986161 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-1fc95b26-fcf4-4539-a4ba-e5fed3df1eb3 req-69edb9b5-abd7-4b09-a7f4-18d76a6a4dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6443b855-1525-4e40-bfa0-a16e1c2de983", "name": "network-vif-plugged", "status": "completed", "tag": "031c6bd4-83ae-48dd-b676-61131c7d8178"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:27:26.995551 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-1fc95b26-fcf4-4539-a4ba-e5fed3df1eb3 req-69edb9b5-abd7-4b09-a7f4-18d76a6a4dc8 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:26.996149 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-1fc95b26-fcf4-4539-a4ba-e5fed3df1eb3 req-69edb9b5-abd7-4b09-a7f4-18d76a6a4dc8 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:27.007807 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-1fc95b26-fcf4-4539-a4ba-e5fed3df1eb3 req-69edb9b5-abd7-4b09-a7f4-18d76a6a4dc8 service nova] Creating event network-vif-plugged:031c6bd4-83ae-48dd-b676-61131c7d8178 for instance 6443b855-1525-4e40-bfa0-a16e1c2de983 on hv-cinder-83625 Apr 12 00:27:27.012987 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-1fc95b26-fcf4-4539-a4ba-e5fed3df1eb3 req-69edb9b5-abd7-4b09-a7f4-18d76a6a4dc8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030492 Apr 12 00:27:27.013609 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 118/225] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:27:27.125924 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-51529e60-85b4-4596-91f7-9c5d45538be5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:27.126570 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-51529e60-85b4-4596-91f7-9c5d45538be5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:27.132893 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-51529e60-85b4-4596-91f7-9c5d45538be5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:27.133333 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-51529e60-85b4-4596-91f7-9c5d45538be5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:27.134104 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-51529e60-85b4-4596-91f7-9c5d45538be5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:27.134561 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-51529e60-85b4-4596-91f7-9c5d45538be5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:27.263799 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-51529e60-85b4-4596-91f7-9c5d45538be5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:27.270983 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-51529e60-85b4-4596-91f7-9c5d45538be5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.148944 Apr 12 00:27:27.271546 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 108/226] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:27 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:27.738017 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5cbb6ed7-0059-4c73-a5ab-3ac6bdeb7cb1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:27.738738 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5cbb6ed7-0059-4c73-a5ab-3ac6bdeb7cb1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:27.744713 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5cbb6ed7-0059-4c73-a5ab-3ac6bdeb7cb1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:27.745166 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5cbb6ed7-0059-4c73-a5ab-3ac6bdeb7cb1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:27.745922 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5cbb6ed7-0059-4c73-a5ab-3ac6bdeb7cb1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:27.746386 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5cbb6ed7-0059-4c73-a5ab-3ac6bdeb7cb1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:27.767610 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4d62105b-9d4c-403b-86d9-4ca74e718d1a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:27.768316 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-4d62105b-9d4c-403b-86d9-4ca74e718d1a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:27.774139 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4d62105b-9d4c-403b-86d9-4ca74e718d1a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:27.774609 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4d62105b-9d4c-403b-86d9-4ca74e718d1a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:27.775618 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4d62105b-9d4c-403b-86d9-4ca74e718d1a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:27.776039 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4d62105b-9d4c-403b-86d9-4ca74e718d1a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:27.870567 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5cbb6ed7-0059-4c73-a5ab-3ac6bdeb7cb1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:27.877774 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5cbb6ed7-0059-4c73-a5ab-3ac6bdeb7cb1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.145011 Apr 12 00:27:27.878362 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 119/227] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:27 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:27.900877 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-4d62105b-9d4c-403b-86d9-4ca74e718d1a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:27.908049 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-4d62105b-9d4c-403b-86d9-4ca74e718d1a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.144524 Apr 12 00:27:27.909149 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 109/228] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:27 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:28.287438 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5d9506fa-af67-4467-a077-15cf755694f0 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:28.288049 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5d9506fa-af67-4467-a077-15cf755694f0 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:28.293894 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5d9506fa-af67-4467-a077-15cf755694f0 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:28.294373 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5d9506fa-af67-4467-a077-15cf755694f0 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:28.295134 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5d9506fa-af67-4467-a077-15cf755694f0 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:28.295564 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5d9506fa-af67-4467-a077-15cf755694f0 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:28.424358 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5d9506fa-af67-4467-a077-15cf755694f0 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:28.431464 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5d9506fa-af67-4467-a077-15cf755694f0 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.148501 Apr 12 00:27:28.432018 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 120/229] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:28 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:28.895421 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b857e2de-3370-42a2-8e25-4e97028be251 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:28.895974 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b857e2de-3370-42a2-8e25-4e97028be251 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:28.902044 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b857e2de-3370-42a2-8e25-4e97028be251 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:28.902518 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b857e2de-3370-42a2-8e25-4e97028be251 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:28.903254 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b857e2de-3370-42a2-8e25-4e97028be251 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:28.903678 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b857e2de-3370-42a2-8e25-4e97028be251 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:28.924833 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8f6bbd89-aa4b-4e78-a3a8-b3e9db7f0b29 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:28.925589 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8f6bbd89-aa4b-4e78-a3a8-b3e9db7f0b29 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:28.932003 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8f6bbd89-aa4b-4e78-a3a8-b3e9db7f0b29 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:28.932468 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8f6bbd89-aa4b-4e78-a3a8-b3e9db7f0b29 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:28.933210 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8f6bbd89-aa4b-4e78-a3a8-b3e9db7f0b29 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:28.933646 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8f6bbd89-aa4b-4e78-a3a8-b3e9db7f0b29 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:29.033331 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b857e2de-3370-42a2-8e25-4e97028be251 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:29.040704 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b857e2de-3370-42a2-8e25-4e97028be251 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.149664 Apr 12 00:27:29.041282 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 110/230] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:28 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:29.057543 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8f6bbd89-aa4b-4e78-a3a8-b3e9db7f0b29 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:29.064769 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8f6bbd89-aa4b-4e78-a3a8-b3e9db7f0b29 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.143625 Apr 12 00:27:29.065335 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 121/231] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:28 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:29.448410 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-cdf9495d-9dc9-4ba8-9bcb-85b6c0e1fbaf tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:29.449011 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-cdf9495d-9dc9-4ba8-9bcb-85b6c0e1fbaf tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:29.454732 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cdf9495d-9dc9-4ba8-9bcb-85b6c0e1fbaf tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:29.455172 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cdf9495d-9dc9-4ba8-9bcb-85b6c0e1fbaf tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:29.455918 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cdf9495d-9dc9-4ba8-9bcb-85b6c0e1fbaf tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:29.456341 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cdf9495d-9dc9-4ba8-9bcb-85b6c0e1fbaf tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:29.580866 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-cdf9495d-9dc9-4ba8-9bcb-85b6c0e1fbaf tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:29.587964 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-cdf9495d-9dc9-4ba8-9bcb-85b6c0e1fbaf tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.143301 Apr 12 00:27:29.588526 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 111/232] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:29 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:30.058086 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ac0710d6-f2ae-48cc-96fd-62192d09cba5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:30.060304 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ac0710d6-f2ae-48cc-96fd-62192d09cba5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:30.065481 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ac0710d6-f2ae-48cc-96fd-62192d09cba5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:30.065978 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ac0710d6-f2ae-48cc-96fd-62192d09cba5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:30.066816 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ac0710d6-f2ae-48cc-96fd-62192d09cba5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:30.067260 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ac0710d6-f2ae-48cc-96fd-62192d09cba5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:30.080729 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f92062f4-5854-4d45-823f-e7af4a3873ab tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:30.081400 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f92062f4-5854-4d45-823f-e7af4a3873ab tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:30.087147 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f92062f4-5854-4d45-823f-e7af4a3873ab tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:30.087596 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f92062f4-5854-4d45-823f-e7af4a3873ab tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:30.088356 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f92062f4-5854-4d45-823f-e7af4a3873ab tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:30.088792 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f92062f4-5854-4d45-823f-e7af4a3873ab tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:30.196165 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ac0710d6-f2ae-48cc-96fd-62192d09cba5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:30.203613 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ac0710d6-f2ae-48cc-96fd-62192d09cba5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.149223 Apr 12 00:27:30.204054 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 122/233] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:30 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:30.218145 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f92062f4-5854-4d45-823f-e7af4a3873ab tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:30.225761 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f92062f4-5854-4d45-823f-e7af4a3873ab tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.148861 Apr 12 00:27:30.226346 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 112/234] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:30 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:30.604623 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0b7a098b-0405-4842-9d23-db384ce31a65 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:30.605237 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0b7a098b-0405-4842-9d23-db384ce31a65 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:30.611167 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0b7a098b-0405-4842-9d23-db384ce31a65 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:30.611658 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0b7a098b-0405-4842-9d23-db384ce31a65 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:30.612460 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0b7a098b-0405-4842-9d23-db384ce31a65 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:30.612899 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0b7a098b-0405-4842-9d23-db384ce31a65 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:30.734640 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0b7a098b-0405-4842-9d23-db384ce31a65 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:30.741813 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0b7a098b-0405-4842-9d23-db384ce31a65 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.140971 Apr 12 00:27:30.742407 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 123/235] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:30 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:31.220354 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-ceb218fe-3293-4d4e-84a0-9db40b2a565e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:31.220959 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-ceb218fe-3293-4d4e-84a0-9db40b2a565e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:31.226783 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ceb218fe-3293-4d4e-84a0-9db40b2a565e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:31.227234 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ceb218fe-3293-4d4e-84a0-9db40b2a565e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:31.227985 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ceb218fe-3293-4d4e-84a0-9db40b2a565e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:31.228414 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ceb218fe-3293-4d4e-84a0-9db40b2a565e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:31.242585 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4fcca938-699c-4c0b-84a9-ffb0d31083a4 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:31.243188 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4fcca938-699c-4c0b-84a9-ffb0d31083a4 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:31.249304 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4fcca938-699c-4c0b-84a9-ffb0d31083a4 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:31.249749 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4fcca938-699c-4c0b-84a9-ffb0d31083a4 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:31.250525 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4fcca938-699c-4c0b-84a9-ffb0d31083a4 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:31.250961 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4fcca938-699c-4c0b-84a9-ffb0d31083a4 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:31.356793 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ceb218fe-3293-4d4e-84a0-9db40b2a565e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:31.365086 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-ceb218fe-3293-4d4e-84a0-9db40b2a565e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.148499 Apr 12 00:27:31.365928 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 113/236] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:31 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:31.378526 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4fcca938-699c-4c0b-84a9-ffb0d31083a4 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:31.385721 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4fcca938-699c-4c0b-84a9-ffb0d31083a4 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.146885 Apr 12 00:27:31.386302 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 124/237] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:31 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:31.758926 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-8b4be5cf-2b31-47ea-89f9-43e8aad8873a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:31.759536 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-8b4be5cf-2b31-47ea-89f9-43e8aad8873a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:31.765234 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8b4be5cf-2b31-47ea-89f9-43e8aad8873a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:31.765680 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8b4be5cf-2b31-47ea-89f9-43e8aad8873a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:31.766471 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8b4be5cf-2b31-47ea-89f9-43e8aad8873a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:31.766903 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8b4be5cf-2b31-47ea-89f9-43e8aad8873a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:31.893146 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-8b4be5cf-2b31-47ea-89f9-43e8aad8873a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:31.900610 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-8b4be5cf-2b31-47ea-89f9-43e8aad8873a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.145523 Apr 12 00:27:31.901180 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 114/238] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:31 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:32.381830 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-fcc25fa3-8ad0-4bcc-8ec2-16820b1342b4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:32.382464 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-fcc25fa3-8ad0-4bcc-8ec2-16820b1342b4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:32.389271 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fcc25fa3-8ad0-4bcc-8ec2-16820b1342b4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:32.389745 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fcc25fa3-8ad0-4bcc-8ec2-16820b1342b4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:32.390664 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fcc25fa3-8ad0-4bcc-8ec2-16820b1342b4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:32.391089 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fcc25fa3-8ad0-4bcc-8ec2-16820b1342b4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:32.402509 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c14d1ad9-80d5-40a2-9960-0a00b1bce186 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:32.403211 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c14d1ad9-80d5-40a2-9960-0a00b1bce186 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:32.409572 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c14d1ad9-80d5-40a2-9960-0a00b1bce186 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:32.410015 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c14d1ad9-80d5-40a2-9960-0a00b1bce186 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:32.410794 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c14d1ad9-80d5-40a2-9960-0a00b1bce186 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:32.411225 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c14d1ad9-80d5-40a2-9960-0a00b1bce186 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:32.547806 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c14d1ad9-80d5-40a2-9960-0a00b1bce186 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:32.555633 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c14d1ad9-80d5-40a2-9960-0a00b1bce186 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.157109 Apr 12 00:27:32.556225 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 115/239] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:32 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:32.703811 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-fcc25fa3-8ad0-4bcc-8ec2-16820b1342b4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:32.711867 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-fcc25fa3-8ad0-4bcc-8ec2-16820b1342b4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.333863 Apr 12 00:27:32.712493 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 125/240] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:32 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:32.917162 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-623f9621-3b03-4ec6-a0c6-13e338f81ffd tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:32.917680 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-623f9621-3b03-4ec6-a0c6-13e338f81ffd tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:32.923468 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-623f9621-3b03-4ec6-a0c6-13e338f81ffd tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:32.923984 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-623f9621-3b03-4ec6-a0c6-13e338f81ffd tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:32.925006 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-623f9621-3b03-4ec6-a0c6-13e338f81ffd tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:32.925481 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-623f9621-3b03-4ec6-a0c6-13e338f81ffd tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:33.049733 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-623f9621-3b03-4ec6-a0c6-13e338f81ffd tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:33.056856 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-623f9621-3b03-4ec6-a0c6-13e338f81ffd tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.143545 Apr 12 00:27:33.057412 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 116/241] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:32 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:33.572464 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-807c6616-81e9-45bc-a831-f997a3c6c493 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:33.573076 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-807c6616-81e9-45bc-a831-f997a3c6c493 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:33.579572 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-807c6616-81e9-45bc-a831-f997a3c6c493 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:33.580621 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-807c6616-81e9-45bc-a831-f997a3c6c493 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:33.581395 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-807c6616-81e9-45bc-a831-f997a3c6c493 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:33.581830 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-807c6616-81e9-45bc-a831-f997a3c6c493 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:33.712314 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-807c6616-81e9-45bc-a831-f997a3c6c493 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:33.715101 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-807c6616-81e9-45bc-a831-f997a3c6c493 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.146540 Apr 12 00:27:33.715677 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 126/242] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:33 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:33.731536 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1a297238-4c83-453f-82aa-e23175b09312 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:33.732160 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1a297238-4c83-453f-82aa-e23175b09312 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:33.738751 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1a297238-4c83-453f-82aa-e23175b09312 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:33.739198 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1a297238-4c83-453f-82aa-e23175b09312 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:33.739950 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1a297238-4c83-453f-82aa-e23175b09312 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:33.740375 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1a297238-4c83-453f-82aa-e23175b09312 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:33.871052 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1a297238-4c83-453f-82aa-e23175b09312 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:33.878305 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1a297238-4c83-453f-82aa-e23175b09312 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.150669 Apr 12 00:27:33.878873 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 117/243] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:33 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:34.074002 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a8cade90-ee14-4857-8755-6e4cf6699f3e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:34.074575 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a8cade90-ee14-4857-8755-6e4cf6699f3e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:34.081360 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8cade90-ee14-4857-8755-6e4cf6699f3e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:34.081810 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8cade90-ee14-4857-8755-6e4cf6699f3e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:34.082594 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8cade90-ee14-4857-8755-6e4cf6699f3e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:34.083032 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8cade90-ee14-4857-8755-6e4cf6699f3e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:34.206989 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a8cade90-ee14-4857-8755-6e4cf6699f3e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:34.214970 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a8cade90-ee14-4857-8755-6e4cf6699f3e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.144861 Apr 12 00:27:34.215609 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 127/244] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:34 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:34.734766 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e96b06ae-55de-471e-a2cd-494235b5038c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:34.735959 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e96b06ae-55de-471e-a2cd-494235b5038c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:34.745093 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e96b06ae-55de-471e-a2cd-494235b5038c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:34.745540 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e96b06ae-55de-471e-a2cd-494235b5038c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:34.746373 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e96b06ae-55de-471e-a2cd-494235b5038c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:34.746997 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e96b06ae-55de-471e-a2cd-494235b5038c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:34.897985 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-de1b9354-672a-4d87-ab73-a1bc6f4d8444 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:34.898747 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-de1b9354-672a-4d87-ab73-a1bc6f4d8444 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:34.921829 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-de1b9354-672a-4d87-ab73-a1bc6f4d8444 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:34.925377 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-de1b9354-672a-4d87-ab73-a1bc6f4d8444 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:34.926244 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-de1b9354-672a-4d87-ab73-a1bc6f4d8444 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:34.926895 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-de1b9354-672a-4d87-ab73-a1bc6f4d8444 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:34.990471 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e96b06ae-55de-471e-a2cd-494235b5038c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:34.998322 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e96b06ae-55de-471e-a2cd-494235b5038c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.269920 Apr 12 00:27:35.007910 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 118/245] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:34 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:35.082234 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-de1b9354-672a-4d87-ab73-a1bc6f4d8444 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:35.093648 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-de1b9354-672a-4d87-ab73-a1bc6f4d8444 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.202157 Apr 12 00:27:35.094602 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 128/246] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:34 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:35.227847 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-38fc4399-0866-4f98-a668-c1b1db44c184 req-29dd4382-8a8f-463c-b0ef-15d3bf864155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6042349-8a44-497b-98eb-495d14a01504", "tag": "5f52b226-528b-4264-91d2-43e3ee68cf0e"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:27:35.231974 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9b4b5de7-daa6-4d50-8942-57d849f3a605 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:35.232818 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9b4b5de7-daa6-4d50-8942-57d849f3a605 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:35.236718 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-38fc4399-0866-4f98-a668-c1b1db44c184 req-29dd4382-8a8f-463c-b0ef-15d3bf864155 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:35.237165 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-38fc4399-0866-4f98-a668-c1b1db44c184 req-29dd4382-8a8f-463c-b0ef-15d3bf864155 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:35.239459 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9b4b5de7-daa6-4d50-8942-57d849f3a605 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:35.240129 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9b4b5de7-daa6-4d50-8942-57d849f3a605 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:35.241306 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9b4b5de7-daa6-4d50-8942-57d849f3a605 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:35.242089 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9b4b5de7-daa6-4d50-8942-57d849f3a605 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:35.253451 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-38fc4399-0866-4f98-a668-c1b1db44c184 req-29dd4382-8a8f-463c-b0ef-15d3bf864155 service nova] Creating event network-changed:5f52b226-528b-4264-91d2-43e3ee68cf0e for instance d6042349-8a44-497b-98eb-495d14a01504 on hv-cinder-83625 Apr 12 00:27:35.259031 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-38fc4399-0866-4f98-a668-c1b1db44c184 req-29dd4382-8a8f-463c-b0ef-15d3bf864155 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034925 Apr 12 00:27:35.260328 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 119/247] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:27:35.374001 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9b4b5de7-daa6-4d50-8942-57d849f3a605 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:35.381095 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9b4b5de7-daa6-4d50-8942-57d849f3a605 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.152948 Apr 12 00:27:35.381653 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 129/248] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:35 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:36.014719 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-841b7a5c-b1ba-4a1f-804a-bf861df01401 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:36.015430 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-841b7a5c-b1ba-4a1f-804a-bf861df01401 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:36.021546 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-841b7a5c-b1ba-4a1f-804a-bf861df01401 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:36.021981 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-841b7a5c-b1ba-4a1f-804a-bf861df01401 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:36.022754 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-841b7a5c-b1ba-4a1f-804a-bf861df01401 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:36.023176 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-841b7a5c-b1ba-4a1f-804a-bf861df01401 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:36.110867 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-504e092f-13a7-4684-9d08-928a595672eb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:36.112166 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-504e092f-13a7-4684-9d08-928a595672eb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:36.118217 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-504e092f-13a7-4684-9d08-928a595672eb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:36.118714 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-504e092f-13a7-4684-9d08-928a595672eb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:36.119464 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-504e092f-13a7-4684-9d08-928a595672eb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:36.119905 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-504e092f-13a7-4684-9d08-928a595672eb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:36.150879 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-841b7a5c-b1ba-4a1f-804a-bf861df01401 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:36.159615 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-841b7a5c-b1ba-4a1f-804a-bf861df01401 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.148927 Apr 12 00:27:36.162553 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 120/249] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:36 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:36.246881 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-504e092f-13a7-4684-9d08-928a595672eb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:36.254446 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-504e092f-13a7-4684-9d08-928a595672eb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.147224 Apr 12 00:27:36.255035 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 130/250] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:36 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:36.397921 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-85fdbc63-2944-4330-a99d-229f0cfaac44 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:36.398561 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-85fdbc63-2944-4330-a99d-229f0cfaac44 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:36.404671 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-85fdbc63-2944-4330-a99d-229f0cfaac44 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:36.405112 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-85fdbc63-2944-4330-a99d-229f0cfaac44 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:36.405869 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-85fdbc63-2944-4330-a99d-229f0cfaac44 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:36.406327 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-85fdbc63-2944-4330-a99d-229f0cfaac44 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:36.530344 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-85fdbc63-2944-4330-a99d-229f0cfaac44 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:36.537393 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-85fdbc63-2944-4330-a99d-229f0cfaac44 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.143274 Apr 12 00:27:36.537984 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 121/251] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:36 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:37.176302 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-db82a08b-58d1-486b-a18a-5dd9235a3968 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:37.176917 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-db82a08b-58d1-486b-a18a-5dd9235a3968 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:37.183232 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-db82a08b-58d1-486b-a18a-5dd9235a3968 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:37.183686 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-db82a08b-58d1-486b-a18a-5dd9235a3968 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:37.184443 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-db82a08b-58d1-486b-a18a-5dd9235a3968 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:37.184880 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-db82a08b-58d1-486b-a18a-5dd9235a3968 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:37.271845 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b55d3080-7bc6-4719-8133-a92269cdab30 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:37.272450 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b55d3080-7bc6-4719-8133-a92269cdab30 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:37.278620 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b55d3080-7bc6-4719-8133-a92269cdab30 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:37.279068 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b55d3080-7bc6-4719-8133-a92269cdab30 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:37.279829 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b55d3080-7bc6-4719-8133-a92269cdab30 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:37.280264 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b55d3080-7bc6-4719-8133-a92269cdab30 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:37.309954 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-db82a08b-58d1-486b-a18a-5dd9235a3968 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:37.317355 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-db82a08b-58d1-486b-a18a-5dd9235a3968 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.144996 Apr 12 00:27:37.317938 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 131/252] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:37 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:37.410743 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b55d3080-7bc6-4719-8133-a92269cdab30 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:37.417892 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b55d3080-7bc6-4719-8133-a92269cdab30 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.150323 Apr 12 00:27:37.418496 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 122/253] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:37 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:37.554143 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-6d3fc6dd-e448-4d9a-98f1-ed6167007be2 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:37.554709 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-6d3fc6dd-e448-4d9a-98f1-ed6167007be2 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:37.560603 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6d3fc6dd-e448-4d9a-98f1-ed6167007be2 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:37.561054 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6d3fc6dd-e448-4d9a-98f1-ed6167007be2 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:37.561818 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6d3fc6dd-e448-4d9a-98f1-ed6167007be2 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:37.562265 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6d3fc6dd-e448-4d9a-98f1-ed6167007be2 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:37.691790 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-6d3fc6dd-e448-4d9a-98f1-ed6167007be2 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:37.700519 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-6d3fc6dd-e448-4d9a-98f1-ed6167007be2 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.150334 Apr 12 00:27:37.701108 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 132/254] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:37 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:38.333961 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-74cf1cff-ef0d-4a33-b34d-172398a6bc79 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:38.334599 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-74cf1cff-ef0d-4a33-b34d-172398a6bc79 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:38.340522 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-74cf1cff-ef0d-4a33-b34d-172398a6bc79 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:38.340963 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-74cf1cff-ef0d-4a33-b34d-172398a6bc79 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:38.341712 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-74cf1cff-ef0d-4a33-b34d-172398a6bc79 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:38.342139 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-74cf1cff-ef0d-4a33-b34d-172398a6bc79 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:38.434473 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7b1f6dce-6825-4f35-ac00-fe3500f261b4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:38.435176 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7b1f6dce-6825-4f35-ac00-fe3500f261b4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:38.441406 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b1f6dce-6825-4f35-ac00-fe3500f261b4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:38.441929 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b1f6dce-6825-4f35-ac00-fe3500f261b4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:38.442815 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b1f6dce-6825-4f35-ac00-fe3500f261b4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:38.443317 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b1f6dce-6825-4f35-ac00-fe3500f261b4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:38.467232 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-74cf1cff-ef0d-4a33-b34d-172398a6bc79 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:38.475056 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-74cf1cff-ef0d-4a33-b34d-172398a6bc79 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.144859 Apr 12 00:27:38.475635 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 123/255] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:38 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:38.567116 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7b1f6dce-6825-4f35-ac00-fe3500f261b4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:38.574282 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7b1f6dce-6825-4f35-ac00-fe3500f261b4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.143616 Apr 12 00:27:38.574841 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 133/256] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:38 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:38.716643 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-83023eee-ecb5-40e0-83dd-4d5e2c2da9ae tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:38.717254 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-83023eee-ecb5-40e0-83dd-4d5e2c2da9ae tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:38.723779 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-83023eee-ecb5-40e0-83dd-4d5e2c2da9ae tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:38.724225 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-83023eee-ecb5-40e0-83dd-4d5e2c2da9ae tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:38.724995 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-83023eee-ecb5-40e0-83dd-4d5e2c2da9ae tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:38.725424 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-83023eee-ecb5-40e0-83dd-4d5e2c2da9ae tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:38.852686 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-83023eee-ecb5-40e0-83dd-4d5e2c2da9ae tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:38.860119 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-83023eee-ecb5-40e0-83dd-4d5e2c2da9ae tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.147259 Apr 12 00:27:38.860695 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 124/257] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:38 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:39.491481 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-10d6291e-63ac-4b75-a16c-8a029a728753 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:39.492087 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-10d6291e-63ac-4b75-a16c-8a029a728753 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:39.498240 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-10d6291e-63ac-4b75-a16c-8a029a728753 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:39.498713 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-10d6291e-63ac-4b75-a16c-8a029a728753 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:39.499463 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-10d6291e-63ac-4b75-a16c-8a029a728753 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:39.499888 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-10d6291e-63ac-4b75-a16c-8a029a728753 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:39.591501 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2fe5c00d-f812-4be0-bccc-0ae010ffacb8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:39.592108 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2fe5c00d-f812-4be0-bccc-0ae010ffacb8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:39.598668 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2fe5c00d-f812-4be0-bccc-0ae010ffacb8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:39.599139 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2fe5c00d-f812-4be0-bccc-0ae010ffacb8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:39.599899 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2fe5c00d-f812-4be0-bccc-0ae010ffacb8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:39.600330 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2fe5c00d-f812-4be0-bccc-0ae010ffacb8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:39.625945 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-10d6291e-63ac-4b75-a16c-8a029a728753 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:39.633761 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-10d6291e-63ac-4b75-a16c-8a029a728753 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.146070 Apr 12 00:27:39.634356 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 134/258] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:39 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:39.724635 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2fe5c00d-f812-4be0-bccc-0ae010ffacb8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:39.731759 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2fe5c00d-f812-4be0-bccc-0ae010ffacb8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.144074 Apr 12 00:27:39.732321 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 125/259] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:39 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:39.877899 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-44093f6b-1b69-41c4-bc04-4f1bb84a3701 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:39.878490 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-44093f6b-1b69-41c4-bc04-4f1bb84a3701 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:39.884299 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-44093f6b-1b69-41c4-bc04-4f1bb84a3701 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:39.884749 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-44093f6b-1b69-41c4-bc04-4f1bb84a3701 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:39.885511 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-44093f6b-1b69-41c4-bc04-4f1bb84a3701 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:39.885949 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-44093f6b-1b69-41c4-bc04-4f1bb84a3701 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:40.008738 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-44093f6b-1b69-41c4-bc04-4f1bb84a3701 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:40.015860 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-44093f6b-1b69-41c4-bc04-4f1bb84a3701 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.142418 Apr 12 00:27:40.016424 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 135/260] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:39 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:40.651376 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-ef1f86fc-c75c-4880-b02e-6caa32fcef74 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:40.651927 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-ef1f86fc-c75c-4880-b02e-6caa32fcef74 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:40.657788 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ef1f86fc-c75c-4880-b02e-6caa32fcef74 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:40.658236 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ef1f86fc-c75c-4880-b02e-6caa32fcef74 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:40.659012 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ef1f86fc-c75c-4880-b02e-6caa32fcef74 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:40.659443 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ef1f86fc-c75c-4880-b02e-6caa32fcef74 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:40.748523 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-727e317b-5e23-4d9c-b3cd-89bfd17baf1a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:40.749251 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-727e317b-5e23-4d9c-b3cd-89bfd17baf1a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:40.756300 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-727e317b-5e23-4d9c-b3cd-89bfd17baf1a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:40.756780 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-727e317b-5e23-4d9c-b3cd-89bfd17baf1a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:40.757554 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-727e317b-5e23-4d9c-b3cd-89bfd17baf1a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:40.757988 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-727e317b-5e23-4d9c-b3cd-89bfd17baf1a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:40.785529 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ef1f86fc-c75c-4880-b02e-6caa32fcef74 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:40.792822 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-ef1f86fc-c75c-4880-b02e-6caa32fcef74 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.145614 Apr 12 00:27:40.793619 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 126/261] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:40 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:40.883026 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-727e317b-5e23-4d9c-b3cd-89bfd17baf1a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:40.890210 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-727e317b-5e23-4d9c-b3cd-89bfd17baf1a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.145447 Apr 12 00:27:40.890808 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 136/262] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:40 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:41.033355 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2f827003-9e72-489d-85a6-df6f99c2c6b3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:41.033966 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2f827003-9e72-489d-85a6-df6f99c2c6b3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:41.039739 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2f827003-9e72-489d-85a6-df6f99c2c6b3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:41.040178 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2f827003-9e72-489d-85a6-df6f99c2c6b3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:41.040921 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2f827003-9e72-489d-85a6-df6f99c2c6b3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:41.041344 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2f827003-9e72-489d-85a6-df6f99c2c6b3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:41.164441 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2f827003-9e72-489d-85a6-df6f99c2c6b3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:41.171730 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2f827003-9e72-489d-85a6-df6f99c2c6b3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.142879 Apr 12 00:27:41.172299 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 127/263] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:41 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:41.810294 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-71bce91f-58c1-413b-82cb-feeb624ee26a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:41.810904 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-71bce91f-58c1-413b-82cb-feeb624ee26a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:41.817653 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-71bce91f-58c1-413b-82cb-feeb624ee26a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:41.818102 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-71bce91f-58c1-413b-82cb-feeb624ee26a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:41.818890 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-71bce91f-58c1-413b-82cb-feeb624ee26a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:41.819322 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-71bce91f-58c1-413b-82cb-feeb624ee26a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:41.906788 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-56dfd9d3-a279-4861-922d-1493e1a11b62 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:41.907390 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-56dfd9d3-a279-4861-922d-1493e1a11b62 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:41.915399 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-56dfd9d3-a279-4861-922d-1493e1a11b62 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:41.915584 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-56dfd9d3-a279-4861-922d-1493e1a11b62 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:41.916374 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-56dfd9d3-a279-4861-922d-1493e1a11b62 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:41.916869 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-56dfd9d3-a279-4861-922d-1493e1a11b62 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:41.951372 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-71bce91f-58c1-413b-82cb-feeb624ee26a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:41.958585 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-71bce91f-58c1-413b-82cb-feeb624ee26a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.152122 Apr 12 00:27:41.959160 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 137/264] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:41 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:42.044544 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-56dfd9d3-a279-4861-922d-1493e1a11b62 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:42.051695 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-56dfd9d3-a279-4861-922d-1493e1a11b62 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.148922 Apr 12 00:27:42.052269 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 128/265] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:41 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:42.188039 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-386b6c6b-e8f0-4192-be5e-89b55ad4175d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:42.188668 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-386b6c6b-e8f0-4192-be5e-89b55ad4175d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:42.194503 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-386b6c6b-e8f0-4192-be5e-89b55ad4175d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:42.194972 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-386b6c6b-e8f0-4192-be5e-89b55ad4175d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:42.195739 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-386b6c6b-e8f0-4192-be5e-89b55ad4175d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:42.196189 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-386b6c6b-e8f0-4192-be5e-89b55ad4175d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:42.319625 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-386b6c6b-e8f0-4192-be5e-89b55ad4175d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:42.326754 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-386b6c6b-e8f0-4192-be5e-89b55ad4175d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.142606 Apr 12 00:27:42.327322 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 138/266] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:42 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:42.975716 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-8d9306c1-ffba-46e7-9908-60279d3591bb tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:42.976315 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-8d9306c1-ffba-46e7-9908-60279d3591bb tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:42.982213 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8d9306c1-ffba-46e7-9908-60279d3591bb tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:42.982684 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8d9306c1-ffba-46e7-9908-60279d3591bb tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:42.983434 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8d9306c1-ffba-46e7-9908-60279d3591bb tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:42.983861 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8d9306c1-ffba-46e7-9908-60279d3591bb tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:43.068467 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-faa59b80-74cf-4c41-90e4-994a3f8bdcfd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:43.069233 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-faa59b80-74cf-4c41-90e4-994a3f8bdcfd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:43.075637 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-faa59b80-74cf-4c41-90e4-994a3f8bdcfd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:43.076084 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-faa59b80-74cf-4c41-90e4-994a3f8bdcfd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:43.076846 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-faa59b80-74cf-4c41-90e4-994a3f8bdcfd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:43.077326 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-faa59b80-74cf-4c41-90e4-994a3f8bdcfd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:43.112271 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-8d9306c1-ffba-46e7-9908-60279d3591bb tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:43.119666 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-8d9306c1-ffba-46e7-9908-60279d3591bb tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.147832 Apr 12 00:27:43.120248 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 129/267] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:42 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:43.207635 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-faa59b80-74cf-4c41-90e4-994a3f8bdcfd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:43.214999 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-faa59b80-74cf-4c41-90e4-994a3f8bdcfd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.150537 Apr 12 00:27:43.215564 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 139/268] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:43 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:43.344993 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-306e3de6-b386-47ae-b718-3f4d78d6a0ad tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:43.345702 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-306e3de6-b386-47ae-b718-3f4d78d6a0ad tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:43.351618 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-306e3de6-b386-47ae-b718-3f4d78d6a0ad tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:43.352064 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-306e3de6-b386-47ae-b718-3f4d78d6a0ad tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:43.352816 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-306e3de6-b386-47ae-b718-3f4d78d6a0ad tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:43.353244 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-306e3de6-b386-47ae-b718-3f4d78d6a0ad tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:43.476265 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-306e3de6-b386-47ae-b718-3f4d78d6a0ad tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:43.484247 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-306e3de6-b386-47ae-b718-3f4d78d6a0ad tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.143281 Apr 12 00:27:43.484808 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 130/269] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:43 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:44.136817 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0398940b-cad0-402b-bfe7-28e27e99ddc3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:44.137396 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0398940b-cad0-402b-bfe7-28e27e99ddc3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:44.143686 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0398940b-cad0-402b-bfe7-28e27e99ddc3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:44.144127 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0398940b-cad0-402b-bfe7-28e27e99ddc3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:44.144876 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0398940b-cad0-402b-bfe7-28e27e99ddc3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:44.145307 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0398940b-cad0-402b-bfe7-28e27e99ddc3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:44.232572 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4e0cf7a1-b543-4bcc-9a79-912a4bdd70e6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:44.233176 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-4e0cf7a1-b543-4bcc-9a79-912a4bdd70e6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:44.239877 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4e0cf7a1-b543-4bcc-9a79-912a4bdd70e6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:44.240325 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4e0cf7a1-b543-4bcc-9a79-912a4bdd70e6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:44.241070 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4e0cf7a1-b543-4bcc-9a79-912a4bdd70e6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:44.241492 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4e0cf7a1-b543-4bcc-9a79-912a4bdd70e6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:44.269225 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0398940b-cad0-402b-bfe7-28e27e99ddc3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:44.277233 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0398940b-cad0-402b-bfe7-28e27e99ddc3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.144156 Apr 12 00:27:44.277896 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 140/270] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:44 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:44.370462 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-4e0cf7a1-b543-4bcc-9a79-912a4bdd70e6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:44.377587 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-4e0cf7a1-b543-4bcc-9a79-912a4bdd70e6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.148779 Apr 12 00:27:44.378148 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 131/271] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:44 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:44.501099 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a8e7e209-fe84-4fa8-b5b8-54eeff6d9408 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:44.501676 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a8e7e209-fe84-4fa8-b5b8-54eeff6d9408 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:44.507510 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8e7e209-fe84-4fa8-b5b8-54eeff6d9408 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:44.507952 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8e7e209-fe84-4fa8-b5b8-54eeff6d9408 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:44.508729 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8e7e209-fe84-4fa8-b5b8-54eeff6d9408 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:44.509158 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8e7e209-fe84-4fa8-b5b8-54eeff6d9408 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:44.637047 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a8e7e209-fe84-4fa8-b5b8-54eeff6d9408 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:44.644706 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a8e7e209-fe84-4fa8-b5b8-54eeff6d9408 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.147458 Apr 12 00:27:44.645276 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 141/272] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:44 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:45.294467 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2e1c80a0-329a-40cc-aee2-52b7db55aa5e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:45.295000 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2e1c80a0-329a-40cc-aee2-52b7db55aa5e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:45.301071 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2e1c80a0-329a-40cc-aee2-52b7db55aa5e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:45.301523 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2e1c80a0-329a-40cc-aee2-52b7db55aa5e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:45.302338 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2e1c80a0-329a-40cc-aee2-52b7db55aa5e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:45.302774 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2e1c80a0-329a-40cc-aee2-52b7db55aa5e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:45.395277 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e911d409-acf8-44a1-a0fb-3552020bf6ba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:45.396467 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e911d409-acf8-44a1-a0fb-3552020bf6ba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:45.402892 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e911d409-acf8-44a1-a0fb-3552020bf6ba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:45.403352 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e911d409-acf8-44a1-a0fb-3552020bf6ba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:45.404105 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e911d409-acf8-44a1-a0fb-3552020bf6ba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:45.404534 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e911d409-acf8-44a1-a0fb-3552020bf6ba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:45.428020 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2e1c80a0-329a-40cc-aee2-52b7db55aa5e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:45.435314 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2e1c80a0-329a-40cc-aee2-52b7db55aa5e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.144685 Apr 12 00:27:45.436023 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 132/273] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:45 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:45.527589 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e911d409-acf8-44a1-a0fb-3552020bf6ba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:45.535383 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e911d409-acf8-44a1-a0fb-3552020bf6ba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.144428 Apr 12 00:27:45.535960 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 142/274] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:45 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:45.661104 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1d1e25a7-5909-45e6-9416-0125a83a2347 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:45.661760 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1d1e25a7-5909-45e6-9416-0125a83a2347 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:45.667796 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1d1e25a7-5909-45e6-9416-0125a83a2347 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:45.668248 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1d1e25a7-5909-45e6-9416-0125a83a2347 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:45.669007 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1d1e25a7-5909-45e6-9416-0125a83a2347 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:45.669442 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1d1e25a7-5909-45e6-9416-0125a83a2347 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:45.792321 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1d1e25a7-5909-45e6-9416-0125a83a2347 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:45.799578 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1d1e25a7-5909-45e6-9416-0125a83a2347 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.142439 Apr 12 00:27:45.800150 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 133/275] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:45 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:46.452931 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b9860d32-921a-4939-ba7b-1cdfc9c46447 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:46.453537 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b9860d32-921a-4939-ba7b-1cdfc9c46447 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:46.459866 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9860d32-921a-4939-ba7b-1cdfc9c46447 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:46.460395 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9860d32-921a-4939-ba7b-1cdfc9c46447 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:46.461129 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9860d32-921a-4939-ba7b-1cdfc9c46447 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:46.461561 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9860d32-921a-4939-ba7b-1cdfc9c46447 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:46.552902 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e7267a20-e0e7-4d22-9325-a9320f2f06cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:46.553796 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e7267a20-e0e7-4d22-9325-a9320f2f06cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:46.559849 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e7267a20-e0e7-4d22-9325-a9320f2f06cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:46.560296 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e7267a20-e0e7-4d22-9325-a9320f2f06cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:46.561056 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e7267a20-e0e7-4d22-9325-a9320f2f06cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:46.561493 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e7267a20-e0e7-4d22-9325-a9320f2f06cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:46.586647 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b9860d32-921a-4939-ba7b-1cdfc9c46447 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:46.594961 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b9860d32-921a-4939-ba7b-1cdfc9c46447 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.145883 Apr 12 00:27:46.596127 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 143/276] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:46 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:46.692028 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e7267a20-e0e7-4d22-9325-a9320f2f06cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:46.699397 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e7267a20-e0e7-4d22-9325-a9320f2f06cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.151128 Apr 12 00:27:46.699976 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 134/277] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:46 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:46.816593 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c2ef1f67-c9a2-4f3a-89bc-86225bfbf8f2 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:46.817193 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c2ef1f67-c9a2-4f3a-89bc-86225bfbf8f2 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:46.823099 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c2ef1f67-c9a2-4f3a-89bc-86225bfbf8f2 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:46.823539 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c2ef1f67-c9a2-4f3a-89bc-86225bfbf8f2 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:46.824289 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c2ef1f67-c9a2-4f3a-89bc-86225bfbf8f2 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:46.824718 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c2ef1f67-c9a2-4f3a-89bc-86225bfbf8f2 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:46.953512 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-c2ef1f67-c9a2-4f3a-89bc-86225bfbf8f2 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:46.960641 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c2ef1f67-c9a2-4f3a-89bc-86225bfbf8f2 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.148370 Apr 12 00:27:46.961209 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 144/278] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:46 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:47.612473 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3bf6145a-a23f-4faf-b9d0-1e40a08d64b2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:47.613090 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3bf6145a-a23f-4faf-b9d0-1e40a08d64b2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:47.618842 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3bf6145a-a23f-4faf-b9d0-1e40a08d64b2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:47.619285 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3bf6145a-a23f-4faf-b9d0-1e40a08d64b2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:47.620024 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3bf6145a-a23f-4faf-b9d0-1e40a08d64b2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:47.620458 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3bf6145a-a23f-4faf-b9d0-1e40a08d64b2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:47.716590 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-68ee4f18-ba02-4b34-a9b0-fee20f08eca0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:47.717278 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-68ee4f18-ba02-4b34-a9b0-fee20f08eca0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:47.724086 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-68ee4f18-ba02-4b34-a9b0-fee20f08eca0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:47.724606 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-68ee4f18-ba02-4b34-a9b0-fee20f08eca0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:47.725468 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-68ee4f18-ba02-4b34-a9b0-fee20f08eca0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:47.725895 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-68ee4f18-ba02-4b34-a9b0-fee20f08eca0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:47.748003 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-3bf6145a-a23f-4faf-b9d0-1e40a08d64b2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:47.755355 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3bf6145a-a23f-4faf-b9d0-1e40a08d64b2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1319 microversion: 2.1 time: 0.146792 Apr 12 00:27:47.755924 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 135/279] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:47 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:47.849942 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-68ee4f18-ba02-4b34-a9b0-fee20f08eca0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:47.857038 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-68ee4f18-ba02-4b34-a9b0-fee20f08eca0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.144177 Apr 12 00:27:47.857597 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 145/280] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:47 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:47.977009 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b28d638f-a6f6-4fce-a3f8-6b0877f68b03 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:47.977612 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b28d638f-a6f6-4fce-a3f8-6b0877f68b03 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:47.983375 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b28d638f-a6f6-4fce-a3f8-6b0877f68b03 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:47.983813 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b28d638f-a6f6-4fce-a3f8-6b0877f68b03 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:47.984549 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b28d638f-a6f6-4fce-a3f8-6b0877f68b03 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:47.984977 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b28d638f-a6f6-4fce-a3f8-6b0877f68b03 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:48.110318 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b28d638f-a6f6-4fce-a3f8-6b0877f68b03 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:48.118134 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b28d638f-a6f6-4fce-a3f8-6b0877f68b03 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.144931 Apr 12 00:27:48.118734 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 136/281] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:47 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:48.772282 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-608e8068-65ce-4a50-8c80-d60f12c872f0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:48.772896 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-608e8068-65ce-4a50-8c80-d60f12c872f0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:48.779352 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-608e8068-65ce-4a50-8c80-d60f12c872f0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:48.779797 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-608e8068-65ce-4a50-8c80-d60f12c872f0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:48.780553 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-608e8068-65ce-4a50-8c80-d60f12c872f0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:48.780984 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-608e8068-65ce-4a50-8c80-d60f12c872f0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:48.872844 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d75bb8fd-0b8b-4066-8c07-9fb29f495f15 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:48.873551 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d75bb8fd-0b8b-4066-8c07-9fb29f495f15 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:48.879865 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d75bb8fd-0b8b-4066-8c07-9fb29f495f15 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:48.880307 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d75bb8fd-0b8b-4066-8c07-9fb29f495f15 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:48.881096 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d75bb8fd-0b8b-4066-8c07-9fb29f495f15 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:48.881519 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d75bb8fd-0b8b-4066-8c07-9fb29f495f15 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:48.908013 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-608e8068-65ce-4a50-8c80-d60f12c872f0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:48.915392 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-608e8068-65ce-4a50-8c80-d60f12c872f0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1507 microversion: 2.1 time: 0.146923 Apr 12 00:27:48.915967 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 146/282] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:48 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:49.010986 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d75bb8fd-0b8b-4066-8c07-9fb29f495f15 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:49.019223 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d75bb8fd-0b8b-4066-8c07-9fb29f495f15 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1521 microversion: 2.1 time: 0.150314 Apr 12 00:27:49.019788 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 137/283] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:48 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:49.134968 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-447c1ed9-274f-450e-8ce6-6c52d1fecaf9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:49.135611 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-447c1ed9-274f-450e-8ce6-6c52d1fecaf9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:49.141360 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-447c1ed9-274f-450e-8ce6-6c52d1fecaf9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:49.142349 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-447c1ed9-274f-450e-8ce6-6c52d1fecaf9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:49.143122 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-447c1ed9-274f-450e-8ce6-6c52d1fecaf9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:49.143559 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-447c1ed9-274f-450e-8ce6-6c52d1fecaf9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:49.271857 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-447c1ed9-274f-450e-8ce6-6c52d1fecaf9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:49.279581 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-447c1ed9-274f-450e-8ce6-6c52d1fecaf9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.148456 Apr 12 00:27:49.280203 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 147/284] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:49 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:50.036978 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5ab7d4af-e363-4f6e-b622-16ff449a61ac tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:50.037574 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5ab7d4af-e363-4f6e-b622-16ff449a61ac tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:50.043637 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5ab7d4af-e363-4f6e-b622-16ff449a61ac tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:50.044077 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5ab7d4af-e363-4f6e-b622-16ff449a61ac tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:50.044827 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5ab7d4af-e363-4f6e-b622-16ff449a61ac tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:50.045249 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5ab7d4af-e363-4f6e-b622-16ff449a61ac tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:50.256379 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-5ab7d4af-e363-4f6e-b622-16ff449a61ac tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:50.263612 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5ab7d4af-e363-4f6e-b622-16ff449a61ac tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1501 microversion: 2.1 time: 0.231094 Apr 12 00:27:50.264165 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 138/285] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:50 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1501 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:50.280121 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-425f14ed-ddaf-433c-89e3-0282a3e31827 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:50.280736 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-425f14ed-ddaf-433c-89e3-0282a3e31827 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:50.287171 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-425f14ed-ddaf-433c-89e3-0282a3e31827 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:50.287546 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-425f14ed-ddaf-433c-89e3-0282a3e31827 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:50.288300 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-425f14ed-ddaf-433c-89e3-0282a3e31827 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:50.288730 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-425f14ed-ddaf-433c-89e3-0282a3e31827 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:50.296408 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-54bda1fc-7150-4f3c-b52e-8995aa2231fc tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:50.297035 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-54bda1fc-7150-4f3c-b52e-8995aa2231fc tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:50.302807 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-54bda1fc-7150-4f3c-b52e-8995aa2231fc tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:50.303245 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-54bda1fc-7150-4f3c-b52e-8995aa2231fc tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:50.304001 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-54bda1fc-7150-4f3c-b52e-8995aa2231fc tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:50.304427 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-54bda1fc-7150-4f3c-b52e-8995aa2231fc tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:50.424968 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-425f14ed-ddaf-433c-89e3-0282a3e31827 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:50.434162 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-425f14ed-ddaf-433c-89e3-0282a3e31827 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1517 microversion: 2.1 time: 0.157800 Apr 12 00:27:50.434844 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 148/286] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:50 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:50.438483 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-54bda1fc-7150-4f3c-b52e-8995aa2231fc tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:50.446788 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-54bda1fc-7150-4f3c-b52e-8995aa2231fc tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.154183 Apr 12 00:27:50.454933 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 139/287] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:50 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:27:51.464045 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ab5ace93-6931-4f97-881e-6c13d15e6765 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:51.464726 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ab5ace93-6931-4f97-881e-6c13d15e6765 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:51.472051 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ab5ace93-6931-4f97-881e-6c13d15e6765 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:51.472564 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ab5ace93-6931-4f97-881e-6c13d15e6765 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:51.473357 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ab5ace93-6931-4f97-881e-6c13d15e6765 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:51.473791 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ab5ace93-6931-4f97-881e-6c13d15e6765 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:51.605846 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ab5ace93-6931-4f97-881e-6c13d15e6765 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:51.613308 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ab5ace93-6931-4f97-881e-6c13d15e6765 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.153070 Apr 12 00:27:51.613868 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 149/288] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:51 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:52.630306 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-26f9bc0e-e5e6-4051-82e3-1e5e7dc45c2a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:52.630844 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-26f9bc0e-e5e6-4051-82e3-1e5e7dc45c2a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:52.637324 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-26f9bc0e-e5e6-4051-82e3-1e5e7dc45c2a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:52.637768 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-26f9bc0e-e5e6-4051-82e3-1e5e7dc45c2a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:52.638550 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-26f9bc0e-e5e6-4051-82e3-1e5e7dc45c2a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:52.638979 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-26f9bc0e-e5e6-4051-82e3-1e5e7dc45c2a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:52.763718 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-26f9bc0e-e5e6-4051-82e3-1e5e7dc45c2a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:52.771416 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-26f9bc0e-e5e6-4051-82e3-1e5e7dc45c2a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.145020 Apr 12 00:27:52.771977 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 140/289] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:52 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:53.788803 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e42887b4-c6f8-4d30-a38c-a7b20cea7c4a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:53.789411 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e42887b4-c6f8-4d30-a38c-a7b20cea7c4a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:53.795919 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e42887b4-c6f8-4d30-a38c-a7b20cea7c4a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:53.796382 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e42887b4-c6f8-4d30-a38c-a7b20cea7c4a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:53.797137 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e42887b4-c6f8-4d30-a38c-a7b20cea7c4a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:53.797570 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e42887b4-c6f8-4d30-a38c-a7b20cea7c4a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:53.945991 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e42887b4-c6f8-4d30-a38c-a7b20cea7c4a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:53.953453 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e42887b4-c6f8-4d30-a38c-a7b20cea7c4a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.168956 Apr 12 00:27:53.954147 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 150/290] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:53 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:54.972753 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-cbe92c2f-2684-4932-8be2-cbfb7ea4ec30 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:54.973482 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-cbe92c2f-2684-4932-8be2-cbfb7ea4ec30 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:54.979263 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cbe92c2f-2684-4932-8be2-cbfb7ea4ec30 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:54.979710 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cbe92c2f-2684-4932-8be2-cbfb7ea4ec30 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:54.980465 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cbe92c2f-2684-4932-8be2-cbfb7ea4ec30 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:54.980898 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cbe92c2f-2684-4932-8be2-cbfb7ea4ec30 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:55.108972 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-cbe92c2f-2684-4932-8be2-cbfb7ea4ec30 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:55.116733 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-cbe92c2f-2684-4932-8be2-cbfb7ea4ec30 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.147846 Apr 12 00:27:55.117298 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 141/291] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:54 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:56.133086 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-aced2e65-5004-45a7-8568-98f8a93ee590 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:56.133730 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-aced2e65-5004-45a7-8568-98f8a93ee590 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:56.139980 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-aced2e65-5004-45a7-8568-98f8a93ee590 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:56.140479 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-aced2e65-5004-45a7-8568-98f8a93ee590 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:56.141251 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-aced2e65-5004-45a7-8568-98f8a93ee590 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:56.142403 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-aced2e65-5004-45a7-8568-98f8a93ee590 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:56.275037 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-aced2e65-5004-45a7-8568-98f8a93ee590 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:56.282101 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-aced2e65-5004-45a7-8568-98f8a93ee590 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.152999 Apr 12 00:27:56.282744 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 151/292] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:56 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:57.298814 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-de7d7657-96c2-4386-b246-1856af6265e7 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:57.299345 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-de7d7657-96c2-4386-b246-1856af6265e7 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:57.305138 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-de7d7657-96c2-4386-b246-1856af6265e7 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:57.305580 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-de7d7657-96c2-4386-b246-1856af6265e7 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:57.306388 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-de7d7657-96c2-4386-b246-1856af6265e7 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:57.306820 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-de7d7657-96c2-4386-b246-1856af6265e7 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:57.429242 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-de7d7657-96c2-4386-b246-1856af6265e7 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:57.436576 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-de7d7657-96c2-4386-b246-1856af6265e7 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.141686 Apr 12 00:27:57.437169 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 142/293] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:57 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:58.453059 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-33c4bdf4-d9b9-4aac-b750-84ca55ca3a8c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:58.453698 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-33c4bdf4-d9b9-4aac-b750-84ca55ca3a8c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:58.460402 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-33c4bdf4-d9b9-4aac-b750-84ca55ca3a8c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:58.460853 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-33c4bdf4-d9b9-4aac-b750-84ca55ca3a8c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:58.461608 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-33c4bdf4-d9b9-4aac-b750-84ca55ca3a8c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:58.462064 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-33c4bdf4-d9b9-4aac-b750-84ca55ca3a8c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:58.583495 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-33c4bdf4-d9b9-4aac-b750-84ca55ca3a8c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:58.590813 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-33c4bdf4-d9b9-4aac-b750-84ca55ca3a8c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.141840 Apr 12 00:27:58.591575 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 152/294] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:58 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:59.607737 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-afdefe5e-d9eb-474a-afa8-944778cf4d6f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:59.608339 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-afdefe5e-d9eb-474a-afa8-944778cf4d6f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:27:59.614920 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-afdefe5e-d9eb-474a-afa8-944778cf4d6f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:59.615361 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-afdefe5e-d9eb-474a-afa8-944778cf4d6f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:59.616099 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-afdefe5e-d9eb-474a-afa8-944778cf4d6f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:27:59.616521 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-afdefe5e-d9eb-474a-afa8-944778cf4d6f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:27:59.741935 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-afdefe5e-d9eb-474a-afa8-944778cf4d6f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:27:59.749167 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-afdefe5e-d9eb-474a-afa8-944778cf4d6f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.145239 Apr 12 00:27:59.749736 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 143/295] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:27:59 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:00.767504 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4a749767-a0a1-4dd6-a19c-f7b5e2df3f2f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:00.768135 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4a749767-a0a1-4dd6-a19c-f7b5e2df3f2f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:00.774654 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4a749767-a0a1-4dd6-a19c-f7b5e2df3f2f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:00.775107 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4a749767-a0a1-4dd6-a19c-f7b5e2df3f2f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:00.775872 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4a749767-a0a1-4dd6-a19c-f7b5e2df3f2f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:00.776303 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4a749767-a0a1-4dd6-a19c-f7b5e2df3f2f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:00.902810 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4a749767-a0a1-4dd6-a19c-f7b5e2df3f2f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:00.910077 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4a749767-a0a1-4dd6-a19c-f7b5e2df3f2f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.147147 Apr 12 00:28:00.910695 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 153/296] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:00 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:01.929682 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-853c3931-4843-45cc-b65b-6adc44e6653c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:01.930319 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-853c3931-4843-45cc-b65b-6adc44e6653c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:01.936149 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-853c3931-4843-45cc-b65b-6adc44e6653c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:01.936596 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-853c3931-4843-45cc-b65b-6adc44e6653c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:01.937348 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-853c3931-4843-45cc-b65b-6adc44e6653c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:01.937779 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-853c3931-4843-45cc-b65b-6adc44e6653c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:02.072754 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-853c3931-4843-45cc-b65b-6adc44e6653c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:02.080960 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-853c3931-4843-45cc-b65b-6adc44e6653c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.154906 Apr 12 00:28:02.081539 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 144/297] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:01 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:02.287672 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a315679f-0b9b-40a0-b5eb-e6e82ed5cb7b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:28:02.288692 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a315679f-0b9b-40a0-b5eb-e6e82ed5cb7b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:02.294936 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a315679f-0b9b-40a0-b5eb-e6e82ed5cb7b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:02.295384 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a315679f-0b9b-40a0-b5eb-e6e82ed5cb7b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:02.296140 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a315679f-0b9b-40a0-b5eb-e6e82ed5cb7b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:02.296575 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a315679f-0b9b-40a0-b5eb-e6e82ed5cb7b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:02.318742 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-a315679f-0b9b-40a0-b5eb-e6e82ed5cb7b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lazy-loading 'flavor' on Instance uuid 1f7526a5-050f-4c25-8432-e85eddf41b98 {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:28:02.436009 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a315679f-0b9b-40a0-b5eb-e6e82ed5cb7b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "POST /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98/action" status: 200 len: 32 microversion: 2.1 time: 0.152236 Apr 12 00:28:02.436611 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 154/298] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Apr 12 00:28:02 2022] POST /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 12 00:28:02.448663 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-874aea91-6c39-45b6-aaa1-13ff68dadae3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:02.449268 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-874aea91-6c39-45b6-aaa1-13ff68dadae3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:02.455858 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-874aea91-6c39-45b6-aaa1-13ff68dadae3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:02.456302 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-874aea91-6c39-45b6-aaa1-13ff68dadae3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:02.457313 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-874aea91-6c39-45b6-aaa1-13ff68dadae3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:02.457685 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-874aea91-6c39-45b6-aaa1-13ff68dadae3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:02.594754 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-874aea91-6c39-45b6-aaa1-13ff68dadae3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:02.603228 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-874aea91-6c39-45b6-aaa1-13ff68dadae3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.160539 Apr 12 00:28:02.603997 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 145/299] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:02 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:03.098145 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3e9d89be-4735-4913-bb07-6e6cf32546a9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:03.098871 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3e9d89be-4735-4913-bb07-6e6cf32546a9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:03.104911 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3e9d89be-4735-4913-bb07-6e6cf32546a9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:03.105482 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3e9d89be-4735-4913-bb07-6e6cf32546a9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:03.106266 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3e9d89be-4735-4913-bb07-6e6cf32546a9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:03.106712 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3e9d89be-4735-4913-bb07-6e6cf32546a9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:03.246489 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3e9d89be-4735-4913-bb07-6e6cf32546a9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:03.258743 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3e9d89be-4735-4913-bb07-6e6cf32546a9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.165465 Apr 12 00:28:03.266792 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 155/300] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:03 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:03.620924 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-ae8300cc-76e6-4e8c-b69e-11df9d6e2103 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:03.621467 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-ae8300cc-76e6-4e8c-b69e-11df9d6e2103 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:03.627313 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ae8300cc-76e6-4e8c-b69e-11df9d6e2103 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:03.627778 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ae8300cc-76e6-4e8c-b69e-11df9d6e2103 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:03.628530 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ae8300cc-76e6-4e8c-b69e-11df9d6e2103 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:03.628956 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ae8300cc-76e6-4e8c-b69e-11df9d6e2103 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:03.829619 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ae8300cc-76e6-4e8c-b69e-11df9d6e2103 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:03.837107 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-ae8300cc-76e6-4e8c-b69e-11df9d6e2103 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.220081 Apr 12 00:28:03.837870 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 146/301] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:03 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:04.276293 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ed9bea06-03bf-41c1-9e14-3e5d4d76363b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:04.276912 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ed9bea06-03bf-41c1-9e14-3e5d4d76363b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:04.283801 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ed9bea06-03bf-41c1-9e14-3e5d4d76363b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:04.284257 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ed9bea06-03bf-41c1-9e14-3e5d4d76363b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:04.285030 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ed9bea06-03bf-41c1-9e14-3e5d4d76363b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:04.285494 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ed9bea06-03bf-41c1-9e14-3e5d4d76363b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:04.423787 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ed9bea06-03bf-41c1-9e14-3e5d4d76363b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:04.435728 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ed9bea06-03bf-41c1-9e14-3e5d4d76363b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.163325 Apr 12 00:28:04.436606 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 156/302] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:04 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:04.854610 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-04665673-ec99-4597-8e1f-6ab5c6785027 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:04.855243 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-04665673-ec99-4597-8e1f-6ab5c6785027 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:04.861225 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-04665673-ec99-4597-8e1f-6ab5c6785027 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:04.861812 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-04665673-ec99-4597-8e1f-6ab5c6785027 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:04.862600 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-04665673-ec99-4597-8e1f-6ab5c6785027 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:04.863029 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-04665673-ec99-4597-8e1f-6ab5c6785027 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:04.992252 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-04665673-ec99-4597-8e1f-6ab5c6785027 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:04.999632 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-04665673-ec99-4597-8e1f-6ab5c6785027 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.148926 Apr 12 00:28:05.000259 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 147/303] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:04 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:05.452740 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ceaa87c3-347e-4499-b8f2-e41ac596bd2b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:05.453351 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ceaa87c3-347e-4499-b8f2-e41ac596bd2b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:05.460412 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ceaa87c3-347e-4499-b8f2-e41ac596bd2b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:05.460864 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ceaa87c3-347e-4499-b8f2-e41ac596bd2b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:05.461627 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ceaa87c3-347e-4499-b8f2-e41ac596bd2b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:05.462061 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ceaa87c3-347e-4499-b8f2-e41ac596bd2b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:05.588947 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ceaa87c3-347e-4499-b8f2-e41ac596bd2b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:05.596101 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ceaa87c3-347e-4499-b8f2-e41ac596bd2b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.147190 Apr 12 00:28:05.596665 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 157/304] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:05 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:06.016418 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a4e8b3d0-020a-40ef-b5c5-7be954296640 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:06.017022 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a4e8b3d0-020a-40ef-b5c5-7be954296640 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:06.022836 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a4e8b3d0-020a-40ef-b5c5-7be954296640 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:06.023281 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a4e8b3d0-020a-40ef-b5c5-7be954296640 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:06.024303 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a4e8b3d0-020a-40ef-b5c5-7be954296640 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:06.024734 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a4e8b3d0-020a-40ef-b5c5-7be954296640 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:06.147303 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a4e8b3d0-020a-40ef-b5c5-7be954296640 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:06.161253 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a4e8b3d0-020a-40ef-b5c5-7be954296640 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.148564 Apr 12 00:28:06.161820 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 148/305] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:06 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:06.612722 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-fed02415-2978-4a48-8a27-ce755075458d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:06.613330 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-fed02415-2978-4a48-8a27-ce755075458d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:06.619543 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fed02415-2978-4a48-8a27-ce755075458d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:06.619996 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fed02415-2978-4a48-8a27-ce755075458d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:06.620759 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fed02415-2978-4a48-8a27-ce755075458d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:06.621197 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fed02415-2978-4a48-8a27-ce755075458d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:06.746501 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-fed02415-2978-4a48-8a27-ce755075458d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:06.754436 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-fed02415-2978-4a48-8a27-ce755075458d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.145618 Apr 12 00:28:06.755010 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 158/306] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:06 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:07.178785 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-76e866c9-04d1-4de3-9d9b-e3053313cb29 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:07.179394 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-76e866c9-04d1-4de3-9d9b-e3053313cb29 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:07.185077 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-76e866c9-04d1-4de3-9d9b-e3053313cb29 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:07.185527 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-76e866c9-04d1-4de3-9d9b-e3053313cb29 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:07.186298 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-76e866c9-04d1-4de3-9d9b-e3053313cb29 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:07.186734 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-76e866c9-04d1-4de3-9d9b-e3053313cb29 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:07.315271 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-76e866c9-04d1-4de3-9d9b-e3053313cb29 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:07.322950 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-76e866c9-04d1-4de3-9d9b-e3053313cb29 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.147848 Apr 12 00:28:07.323454 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 149/307] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:07 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:07.771012 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-198a2d7c-b4d7-4ef2-9c51-779364e4956e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:07.771622 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-198a2d7c-b4d7-4ef2-9c51-779364e4956e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:07.778362 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-198a2d7c-b4d7-4ef2-9c51-779364e4956e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:07.778819 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-198a2d7c-b4d7-4ef2-9c51-779364e4956e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:07.779637 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-198a2d7c-b4d7-4ef2-9c51-779364e4956e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:07.780103 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-198a2d7c-b4d7-4ef2-9c51-779364e4956e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:07.906319 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-198a2d7c-b4d7-4ef2-9c51-779364e4956e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:07.914210 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-198a2d7c-b4d7-4ef2-9c51-779364e4956e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.147025 Apr 12 00:28:07.914893 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 159/308] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:07 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:08.339924 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-dd259330-00cb-49ed-8ed3-f032e0a5b1a7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:08.340525 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-dd259330-00cb-49ed-8ed3-f032e0a5b1a7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:08.346344 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dd259330-00cb-49ed-8ed3-f032e0a5b1a7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:08.346853 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dd259330-00cb-49ed-8ed3-f032e0a5b1a7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:08.347556 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dd259330-00cb-49ed-8ed3-f032e0a5b1a7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:08.348035 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dd259330-00cb-49ed-8ed3-f032e0a5b1a7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:08.472648 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-dd259330-00cb-49ed-8ed3-f032e0a5b1a7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:08.479788 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-dd259330-00cb-49ed-8ed3-f032e0a5b1a7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.143779 Apr 12 00:28:08.480345 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 150/309] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:08 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:08.931351 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2f7d2566-919d-445c-930f-70ea1a224cec tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:08.932019 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-2f7d2566-919d-445c-930f-70ea1a224cec tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:08.943113 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2f7d2566-919d-445c-930f-70ea1a224cec tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:08.943553 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2f7d2566-919d-445c-930f-70ea1a224cec tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:08.944310 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2f7d2566-919d-445c-930f-70ea1a224cec tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:08.944737 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2f7d2566-919d-445c-930f-70ea1a224cec tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:09.067375 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2f7d2566-919d-445c-930f-70ea1a224cec tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:09.074984 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2f7d2566-919d-445c-930f-70ea1a224cec tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.147411 Apr 12 00:28:09.075558 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 160/310] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:08 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:09.496744 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a1fdabc2-ff2d-4ed1-b1f2-c483edc0719e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:09.497367 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a1fdabc2-ff2d-4ed1-b1f2-c483edc0719e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:09.503437 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a1fdabc2-ff2d-4ed1-b1f2-c483edc0719e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:09.503875 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a1fdabc2-ff2d-4ed1-b1f2-c483edc0719e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:09.504621 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a1fdabc2-ff2d-4ed1-b1f2-c483edc0719e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:09.505070 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a1fdabc2-ff2d-4ed1-b1f2-c483edc0719e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:09.633149 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a1fdabc2-ff2d-4ed1-b1f2-c483edc0719e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:09.640409 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a1fdabc2-ff2d-4ed1-b1f2-c483edc0719e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.147484 Apr 12 00:28:09.640990 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 151/311] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:09 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:10.092870 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c9dd1762-c60b-46b8-ac17-150cee83344b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:10.093477 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c9dd1762-c60b-46b8-ac17-150cee83344b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:10.099677 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c9dd1762-c60b-46b8-ac17-150cee83344b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:10.100183 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c9dd1762-c60b-46b8-ac17-150cee83344b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:10.100994 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c9dd1762-c60b-46b8-ac17-150cee83344b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:10.101427 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c9dd1762-c60b-46b8-ac17-150cee83344b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:10.205320 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-0b2b61b7-21df-46bb-a44f-aecbc113aa15 req-7a322227-911d-476f-94db-f9d9a45e719e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6042349-8a44-497b-98eb-495d14a01504", "name": "network-vif-plugged", "status": "completed", "tag": "5f52b226-528b-4264-91d2-43e3ee68cf0e"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:28:10.214096 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-0b2b61b7-21df-46bb-a44f-aecbc113aa15 req-7a322227-911d-476f-94db-f9d9a45e719e service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:10.214422 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-0b2b61b7-21df-46bb-a44f-aecbc113aa15 req-7a322227-911d-476f-94db-f9d9a45e719e service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:10.227805 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-0b2b61b7-21df-46bb-a44f-aecbc113aa15 req-7a322227-911d-476f-94db-f9d9a45e719e service nova] Creating event network-vif-plugged:5f52b226-528b-4264-91d2-43e3ee68cf0e for instance d6042349-8a44-497b-98eb-495d14a01504 on hv-cinder-83625 Apr 12 00:28:10.230112 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-c9dd1762-c60b-46b8-ac17-150cee83344b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:10.233700 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-0b2b61b7-21df-46bb-a44f-aecbc113aa15 req-7a322227-911d-476f-94db-f9d9a45e719e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032256 Apr 12 00:28:10.234414 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 152/312] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:28:10.239465 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c9dd1762-c60b-46b8-ac17-150cee83344b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.150396 Apr 12 00:28:10.240194 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 161/313] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:10 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:10.659170 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-abfa29e9-f41b-4697-a44e-4cf86fc3f197 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:10.659794 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-abfa29e9-f41b-4697-a44e-4cf86fc3f197 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:10.666128 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-abfa29e9-f41b-4697-a44e-4cf86fc3f197 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:10.666611 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-abfa29e9-f41b-4697-a44e-4cf86fc3f197 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:10.667404 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-abfa29e9-f41b-4697-a44e-4cf86fc3f197 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:10.667839 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-abfa29e9-f41b-4697-a44e-4cf86fc3f197 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:10.797009 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-abfa29e9-f41b-4697-a44e-4cf86fc3f197 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:10.804259 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-abfa29e9-f41b-4697-a44e-4cf86fc3f197 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.149876 Apr 12 00:28:10.804818 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 153/314] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:10 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:11.257493 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1493f4f6-b39c-4694-aea6-1cc0c80fc42e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:11.258046 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1493f4f6-b39c-4694-aea6-1cc0c80fc42e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:11.264316 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1493f4f6-b39c-4694-aea6-1cc0c80fc42e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:11.264760 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1493f4f6-b39c-4694-aea6-1cc0c80fc42e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:11.265511 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1493f4f6-b39c-4694-aea6-1cc0c80fc42e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:11.265941 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1493f4f6-b39c-4694-aea6-1cc0c80fc42e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:11.408608 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1493f4f6-b39c-4694-aea6-1cc0c80fc42e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:11.416081 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1493f4f6-b39c-4694-aea6-1cc0c80fc42e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.162483 Apr 12 00:28:11.416742 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 162/315] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:11 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:11.820837 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a8de9b4c-120b-45f4-9fb8-bab392862747 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:11.821468 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a8de9b4c-120b-45f4-9fb8-bab392862747 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:11.827522 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a8de9b4c-120b-45f4-9fb8-bab392862747 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:11.827994 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a8de9b4c-120b-45f4-9fb8-bab392862747 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:11.829261 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a8de9b4c-120b-45f4-9fb8-bab392862747 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:11.829696 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a8de9b4c-120b-45f4-9fb8-bab392862747 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:11.960212 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a8de9b4c-120b-45f4-9fb8-bab392862747 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:11.967576 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a8de9b4c-120b-45f4-9fb8-bab392862747 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.150733 Apr 12 00:28:11.968139 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 154/316] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:11 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:12.433354 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-bc7d2650-e79d-4f9d-81ef-5dca9a538b35 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:12.433867 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-bc7d2650-e79d-4f9d-81ef-5dca9a538b35 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:12.441405 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bc7d2650-e79d-4f9d-81ef-5dca9a538b35 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:12.441922 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bc7d2650-e79d-4f9d-81ef-5dca9a538b35 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:12.442815 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bc7d2650-e79d-4f9d-81ef-5dca9a538b35 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:12.443335 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bc7d2650-e79d-4f9d-81ef-5dca9a538b35 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:12.577663 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-bc7d2650-e79d-4f9d-81ef-5dca9a538b35 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:12.585011 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-bc7d2650-e79d-4f9d-81ef-5dca9a538b35 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.156065 Apr 12 00:28:12.585568 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 163/317] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:12 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:12.985340 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-45711e30-eebd-4ec8-927b-fcb89c11c7ad tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:12.985953 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-45711e30-eebd-4ec8-927b-fcb89c11c7ad tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:12.991769 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-45711e30-eebd-4ec8-927b-fcb89c11c7ad tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:12.992222 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-45711e30-eebd-4ec8-927b-fcb89c11c7ad tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:12.992974 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-45711e30-eebd-4ec8-927b-fcb89c11c7ad tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:12.993406 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-45711e30-eebd-4ec8-927b-fcb89c11c7ad tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:13.116151 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-45711e30-eebd-4ec8-927b-fcb89c11c7ad tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:13.123356 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-45711e30-eebd-4ec8-927b-fcb89c11c7ad tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.142465 Apr 12 00:28:13.123920 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 155/318] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:12 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:13.601367 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b764e34b-5eb2-4c21-8766-cb470dc078ab tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:13.601973 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b764e34b-5eb2-4c21-8766-cb470dc078ab tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:13.608202 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b764e34b-5eb2-4c21-8766-cb470dc078ab tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:13.608653 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b764e34b-5eb2-4c21-8766-cb470dc078ab tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:13.609411 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b764e34b-5eb2-4c21-8766-cb470dc078ab tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:13.609894 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b764e34b-5eb2-4c21-8766-cb470dc078ab tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:13.736096 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b764e34b-5eb2-4c21-8766-cb470dc078ab tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:13.743241 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b764e34b-5eb2-4c21-8766-cb470dc078ab tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.145798 Apr 12 00:28:13.743799 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 164/319] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:13 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:14.140458 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-43201416-7e9d-4a40-bfe9-6229109a02aa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:14.141774 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-43201416-7e9d-4a40-bfe9-6229109a02aa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:14.148083 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-43201416-7e9d-4a40-bfe9-6229109a02aa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:14.148520 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-43201416-7e9d-4a40-bfe9-6229109a02aa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:14.149541 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-43201416-7e9d-4a40-bfe9-6229109a02aa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:14.149963 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-43201416-7e9d-4a40-bfe9-6229109a02aa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:14.277865 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-43201416-7e9d-4a40-bfe9-6229109a02aa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:14.285626 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-43201416-7e9d-4a40-bfe9-6229109a02aa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.149204 Apr 12 00:28:14.286196 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 156/320] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:14 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:14.760155 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f4a22c50-c2d9-4d5c-9370-ac885ed26b29 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:14.760741 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f4a22c50-c2d9-4d5c-9370-ac885ed26b29 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:14.767470 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f4a22c50-c2d9-4d5c-9370-ac885ed26b29 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:14.767910 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f4a22c50-c2d9-4d5c-9370-ac885ed26b29 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:14.768665 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f4a22c50-c2d9-4d5c-9370-ac885ed26b29 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:14.769099 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f4a22c50-c2d9-4d5c-9370-ac885ed26b29 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:14.894635 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f4a22c50-c2d9-4d5c-9370-ac885ed26b29 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:14.901988 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f4a22c50-c2d9-4d5c-9370-ac885ed26b29 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.145672 Apr 12 00:28:14.902608 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 165/321] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:14 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:15.303002 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e32ea674-62e0-4533-8a74-b054b8027bf6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:15.303601 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e32ea674-62e0-4533-8a74-b054b8027bf6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:15.309374 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e32ea674-62e0-4533-8a74-b054b8027bf6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:15.309814 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e32ea674-62e0-4533-8a74-b054b8027bf6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:15.310587 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e32ea674-62e0-4533-8a74-b054b8027bf6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:15.311028 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e32ea674-62e0-4533-8a74-b054b8027bf6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:15.441156 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e32ea674-62e0-4533-8a74-b054b8027bf6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:15.448462 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e32ea674-62e0-4533-8a74-b054b8027bf6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.149292 Apr 12 00:28:15.449054 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 157/322] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:15 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:15.918994 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-6f976c84-2863-41fe-953d-fcdfb4adbf5e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:15.919542 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-6f976c84-2863-41fe-953d-fcdfb4adbf5e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:15.926546 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6f976c84-2863-41fe-953d-fcdfb4adbf5e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:15.926990 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6f976c84-2863-41fe-953d-fcdfb4adbf5e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:15.927749 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6f976c84-2863-41fe-953d-fcdfb4adbf5e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:15.928213 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6f976c84-2863-41fe-953d-fcdfb4adbf5e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:16.053796 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-6f976c84-2863-41fe-953d-fcdfb4adbf5e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:16.061063 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-6f976c84-2863-41fe-953d-fcdfb4adbf5e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.145923 Apr 12 00:28:16.061903 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 166/323] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:15 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:16.465212 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-7e989973-0328-4528-ae5f-0c58da77ba21 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:16.465845 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-7e989973-0328-4528-ae5f-0c58da77ba21 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:16.471704 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7e989973-0328-4528-ae5f-0c58da77ba21 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:16.472150 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7e989973-0328-4528-ae5f-0c58da77ba21 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:16.472901 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7e989973-0328-4528-ae5f-0c58da77ba21 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:16.473332 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7e989973-0328-4528-ae5f-0c58da77ba21 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:16.599347 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-7e989973-0328-4528-ae5f-0c58da77ba21 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:16.606378 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-7e989973-0328-4528-ae5f-0c58da77ba21 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.144959 Apr 12 00:28:16.606975 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 158/324] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:16 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:17.077014 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-10a3af3a-eb23-44fd-8064-2e5ab28d85d3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:17.077622 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-10a3af3a-eb23-44fd-8064-2e5ab28d85d3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:17.083881 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-10a3af3a-eb23-44fd-8064-2e5ab28d85d3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:17.084327 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-10a3af3a-eb23-44fd-8064-2e5ab28d85d3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:17.085080 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-10a3af3a-eb23-44fd-8064-2e5ab28d85d3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:17.085508 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-10a3af3a-eb23-44fd-8064-2e5ab28d85d3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:17.212554 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-10a3af3a-eb23-44fd-8064-2e5ab28d85d3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:17.220136 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-10a3af3a-eb23-44fd-8064-2e5ab28d85d3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.146891 Apr 12 00:28:17.220689 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 167/325] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:17 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:17.623234 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-46a6b10e-098e-4584-bd61-31ebc081a473 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:17.623844 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-46a6b10e-098e-4584-bd61-31ebc081a473 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:17.629554 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-46a6b10e-098e-4584-bd61-31ebc081a473 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:17.630001 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-46a6b10e-098e-4584-bd61-31ebc081a473 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:17.630785 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-46a6b10e-098e-4584-bd61-31ebc081a473 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:17.631213 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-46a6b10e-098e-4584-bd61-31ebc081a473 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:17.762421 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-46a6b10e-098e-4584-bd61-31ebc081a473 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:17.770133 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-46a6b10e-098e-4584-bd61-31ebc081a473 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.150724 Apr 12 00:28:17.770825 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 159/326] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:17 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:18.237456 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4fae9bcd-ed03-44a3-99e7-1dabea90d56a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:18.238039 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4fae9bcd-ed03-44a3-99e7-1dabea90d56a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:18.244335 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4fae9bcd-ed03-44a3-99e7-1dabea90d56a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:18.244784 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4fae9bcd-ed03-44a3-99e7-1dabea90d56a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:18.245548 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4fae9bcd-ed03-44a3-99e7-1dabea90d56a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:18.245976 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4fae9bcd-ed03-44a3-99e7-1dabea90d56a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:18.374514 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4fae9bcd-ed03-44a3-99e7-1dabea90d56a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:18.381812 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4fae9bcd-ed03-44a3-99e7-1dabea90d56a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.148689 Apr 12 00:28:18.382427 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 168/327] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:18 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:18.787293 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3f942e02-e9df-4800-918d-cfd5d96bc8d7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:18.787935 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3f942e02-e9df-4800-918d-cfd5d96bc8d7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:18.793801 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3f942e02-e9df-4800-918d-cfd5d96bc8d7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:18.794272 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3f942e02-e9df-4800-918d-cfd5d96bc8d7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:18.795048 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3f942e02-e9df-4800-918d-cfd5d96bc8d7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:18.795486 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3f942e02-e9df-4800-918d-cfd5d96bc8d7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:18.924560 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-3f942e02-e9df-4800-918d-cfd5d96bc8d7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:18.932192 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3f942e02-e9df-4800-918d-cfd5d96bc8d7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.148658 Apr 12 00:28:18.932998 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 160/328] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:18 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:19.399966 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-090955e7-6a9f-4ca4-9df2-f69e947f24c0 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:19.400573 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-090955e7-6a9f-4ca4-9df2-f69e947f24c0 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:19.407442 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-090955e7-6a9f-4ca4-9df2-f69e947f24c0 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:19.407884 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-090955e7-6a9f-4ca4-9df2-f69e947f24c0 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:19.408642 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-090955e7-6a9f-4ca4-9df2-f69e947f24c0 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:19.409070 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-090955e7-6a9f-4ca4-9df2-f69e947f24c0 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:19.538907 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-090955e7-6a9f-4ca4-9df2-f69e947f24c0 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:19.545948 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-090955e7-6a9f-4ca4-9df2-f69e947f24c0 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.150090 Apr 12 00:28:19.546553 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 169/329] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:19 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:19.952727 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-02c59ba4-f0dc-4215-bf39-c25edf77318b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:19.953842 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-02c59ba4-f0dc-4215-bf39-c25edf77318b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:19.959739 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-02c59ba4-f0dc-4215-bf39-c25edf77318b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:19.960192 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-02c59ba4-f0dc-4215-bf39-c25edf77318b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:19.960965 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-02c59ba4-f0dc-4215-bf39-c25edf77318b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:19.961401 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-02c59ba4-f0dc-4215-bf39-c25edf77318b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:20.088232 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-02c59ba4-f0dc-4215-bf39-c25edf77318b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:20.096227 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-02c59ba4-f0dc-4215-bf39-c25edf77318b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.147273 Apr 12 00:28:20.096807 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 161/330] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:19 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:20.563520 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3937e883-60ec-4942-96dd-b8d84e792ef9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:20.564139 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3937e883-60ec-4942-96dd-b8d84e792ef9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:20.570467 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3937e883-60ec-4942-96dd-b8d84e792ef9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:20.570920 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3937e883-60ec-4942-96dd-b8d84e792ef9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:20.571684 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3937e883-60ec-4942-96dd-b8d84e792ef9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:20.572120 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3937e883-60ec-4942-96dd-b8d84e792ef9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:20.697387 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3937e883-60ec-4942-96dd-b8d84e792ef9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:20.704561 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3937e883-60ec-4942-96dd-b8d84e792ef9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.145545 Apr 12 00:28:20.705122 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 170/331] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:20 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:21.113267 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5f930139-1c7d-4af6-9f64-ca1cbdfe56f6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:21.113875 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5f930139-1c7d-4af6-9f64-ca1cbdfe56f6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:21.119689 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5f930139-1c7d-4af6-9f64-ca1cbdfe56f6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:21.120133 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5f930139-1c7d-4af6-9f64-ca1cbdfe56f6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:21.120881 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5f930139-1c7d-4af6-9f64-ca1cbdfe56f6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:21.121310 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5f930139-1c7d-4af6-9f64-ca1cbdfe56f6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:21.242947 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-5f930139-1c7d-4af6-9f64-ca1cbdfe56f6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:21.250164 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5f930139-1c7d-4af6-9f64-ca1cbdfe56f6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.141322 Apr 12 00:28:21.250753 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 162/332] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:21 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:21.721746 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b051d23f-d332-4259-b92b-7c332b4131cf tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:21.722388 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b051d23f-d332-4259-b92b-7c332b4131cf tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:21.728592 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b051d23f-d332-4259-b92b-7c332b4131cf tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:21.729044 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b051d23f-d332-4259-b92b-7c332b4131cf tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:21.729798 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b051d23f-d332-4259-b92b-7c332b4131cf tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:21.730232 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b051d23f-d332-4259-b92b-7c332b4131cf tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:21.856328 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b051d23f-d332-4259-b92b-7c332b4131cf tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:21.864745 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b051d23f-d332-4259-b92b-7c332b4131cf tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.147346 Apr 12 00:28:21.865634 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 171/333] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:21 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:22.266148 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2d0ffeef-eb3a-4e53-a726-51607160bdba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:22.266794 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2d0ffeef-eb3a-4e53-a726-51607160bdba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:22.272462 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2d0ffeef-eb3a-4e53-a726-51607160bdba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:22.272905 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2d0ffeef-eb3a-4e53-a726-51607160bdba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:22.273654 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2d0ffeef-eb3a-4e53-a726-51607160bdba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:22.274381 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2d0ffeef-eb3a-4e53-a726-51607160bdba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:22.402236 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2d0ffeef-eb3a-4e53-a726-51607160bdba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:22.410002 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2d0ffeef-eb3a-4e53-a726-51607160bdba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.147702 Apr 12 00:28:22.410585 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 163/334] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:22 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:22.881208 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-06e1103f-d107-42b8-bae9-c6f3254f7d21 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:22.881818 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-06e1103f-d107-42b8-bae9-c6f3254f7d21 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:22.888163 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-06e1103f-d107-42b8-bae9-c6f3254f7d21 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:22.888609 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-06e1103f-d107-42b8-bae9-c6f3254f7d21 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:22.889370 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-06e1103f-d107-42b8-bae9-c6f3254f7d21 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:22.889830 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-06e1103f-d107-42b8-bae9-c6f3254f7d21 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:23.019966 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-06e1103f-d107-42b8-bae9-c6f3254f7d21 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:23.027849 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-06e1103f-d107-42b8-bae9-c6f3254f7d21 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1314 microversion: 2.1 time: 0.150451 Apr 12 00:28:23.028408 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 172/335] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:22 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:23.427063 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-96c1994f-017d-483f-8b77-5ea5de67902d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:23.427679 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-96c1994f-017d-483f-8b77-5ea5de67902d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:23.433367 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-96c1994f-017d-483f-8b77-5ea5de67902d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:23.433805 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-96c1994f-017d-483f-8b77-5ea5de67902d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:23.434573 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-96c1994f-017d-483f-8b77-5ea5de67902d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:23.435000 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-96c1994f-017d-483f-8b77-5ea5de67902d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:23.558742 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-96c1994f-017d-483f-8b77-5ea5de67902d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:23.566536 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-96c1994f-017d-483f-8b77-5ea5de67902d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.143366 Apr 12 00:28:23.567275 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 164/336] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:23 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:24.044991 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-947633c6-f0b5-47cb-b9a1-c70f45af201d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:24.045595 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-947633c6-f0b5-47cb-b9a1-c70f45af201d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:24.052772 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-947633c6-f0b5-47cb-b9a1-c70f45af201d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:24.053220 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-947633c6-f0b5-47cb-b9a1-c70f45af201d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:24.053980 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-947633c6-f0b5-47cb-b9a1-c70f45af201d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:24.054441 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-947633c6-f0b5-47cb-b9a1-c70f45af201d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:24.179198 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-947633c6-f0b5-47cb-b9a1-c70f45af201d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:24.186492 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-947633c6-f0b5-47cb-b9a1-c70f45af201d tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1498 microversion: 2.1 time: 0.145341 Apr 12 00:28:24.187048 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 173/337] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:24 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1498 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:24.584659 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-af872f1e-c209-47fd-b41a-1698623763e2 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:24.585334 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-af872f1e-c209-47fd-b41a-1698623763e2 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:24.591226 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-af872f1e-c209-47fd-b41a-1698623763e2 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:24.591760 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-af872f1e-c209-47fd-b41a-1698623763e2 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:24.592599 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-af872f1e-c209-47fd-b41a-1698623763e2 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:24.593092 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-af872f1e-c209-47fd-b41a-1698623763e2 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:24.723034 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-af872f1e-c209-47fd-b41a-1698623763e2 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:24.730164 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-af872f1e-c209-47fd-b41a-1698623763e2 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.149493 Apr 12 00:28:24.730751 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 165/338] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:24 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:25.683252 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c45cb667-398f-4dfc-a41b-bbf00970f8f9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:25.683747 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c45cb667-398f-4dfc-a41b-bbf00970f8f9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:25.690476 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c45cb667-398f-4dfc-a41b-bbf00970f8f9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:25.690928 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c45cb667-398f-4dfc-a41b-bbf00970f8f9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:25.691682 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c45cb667-398f-4dfc-a41b-bbf00970f8f9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:25.692118 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c45cb667-398f-4dfc-a41b-bbf00970f8f9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:25.715301 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c45cb667-398f-4dfc-a41b-bbf00970f8f9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Going to try to terminate instance {{(pid=128486) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:28:25.746198 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f4d505c5-1b69-47d6-b675-22005c8d7da1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:25.746831 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f4d505c5-1b69-47d6-b675-22005c8d7da1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:25.753636 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f4d505c5-1b69-47d6-b675-22005c8d7da1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:25.754088 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f4d505c5-1b69-47d6-b675-22005c8d7da1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:25.754875 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f4d505c5-1b69-47d6-b675-22005c8d7da1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:25.755310 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f4d505c5-1b69-47d6-b675-22005c8d7da1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:25.793351 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c45cb667-398f-4dfc-a41b-bbf00970f8f9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 204 len: 0 microversion: 2.1 time: 0.113487 Apr 12 00:28:25.794165 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 174/339] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:28:25 2022] DELETE /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:28:25.803128 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5b64babe-cb0f-4927-b8b8-9149b5aca286 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:25.803891 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5b64babe-cb0f-4927-b8b8-9149b5aca286 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:25.810191 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5b64babe-cb0f-4927-b8b8-9149b5aca286 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:25.810703 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5b64babe-cb0f-4927-b8b8-9149b5aca286 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:25.811476 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5b64babe-cb0f-4927-b8b8-9149b5aca286 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:25.811916 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5b64babe-cb0f-4927-b8b8-9149b5aca286 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:25.887724 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f4d505c5-1b69-47d6-b675-22005c8d7da1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:25.895820 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f4d505c5-1b69-47d6-b675-22005c8d7da1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.153342 Apr 12 00:28:25.896711 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 166/340] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:25 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:25.945172 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5b64babe-cb0f-4927-b8b8-9149b5aca286 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:25.952376 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5b64babe-cb0f-4927-b8b8-9149b5aca286 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1504 microversion: 2.1 time: 0.153709 Apr 12 00:28:25.953015 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 175/341] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:25 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:26.913126 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-85207267-142c-4e95-bb4a-cbaa2c6257cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:26.913660 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-85207267-142c-4e95-bb4a-cbaa2c6257cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:26.919391 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-85207267-142c-4e95-bb4a-cbaa2c6257cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:26.919838 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-85207267-142c-4e95-bb4a-cbaa2c6257cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:26.920589 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-85207267-142c-4e95-bb4a-cbaa2c6257cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:26.921025 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-85207267-142c-4e95-bb4a-cbaa2c6257cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:26.969385 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5bff25ec-e4ff-405e-9fdb-7f0888f4f53b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:26.969385 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5bff25ec-e4ff-405e-9fdb-7f0888f4f53b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:26.975935 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5bff25ec-e4ff-405e-9fdb-7f0888f4f53b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:26.976387 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5bff25ec-e4ff-405e-9fdb-7f0888f4f53b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:26.977152 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5bff25ec-e4ff-405e-9fdb-7f0888f4f53b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:26.977593 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5bff25ec-e4ff-405e-9fdb-7f0888f4f53b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:27.048792 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-85207267-142c-4e95-bb4a-cbaa2c6257cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:27.056389 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-85207267-142c-4e95-bb4a-cbaa2c6257cd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.147183 Apr 12 00:28:27.057065 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 167/342] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:26 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:27.111069 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5bff25ec-e4ff-405e-9fdb-7f0888f4f53b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:27.120981 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5bff25ec-e4ff-405e-9fdb-7f0888f4f53b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1504 microversion: 2.1 time: 0.155474 Apr 12 00:28:27.131222 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 176/343] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:26 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:28.074241 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-17170228-7327-4320-93de-dc2c0b7d4a56 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:28.075131 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-17170228-7327-4320-93de-dc2c0b7d4a56 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:28.081555 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-17170228-7327-4320-93de-dc2c0b7d4a56 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:28.082073 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-17170228-7327-4320-93de-dc2c0b7d4a56 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:28.083152 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-17170228-7327-4320-93de-dc2c0b7d4a56 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:28.083827 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-17170228-7327-4320-93de-dc2c0b7d4a56 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:28.139171 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-05f3b5b2-f617-4068-a860-09712fc894c5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:28.140162 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-05f3b5b2-f617-4068-a860-09712fc894c5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:28.146661 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-05f3b5b2-f617-4068-a860-09712fc894c5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:28.147182 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-05f3b5b2-f617-4068-a860-09712fc894c5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:28.148033 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-05f3b5b2-f617-4068-a860-09712fc894c5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:28.148953 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-05f3b5b2-f617-4068-a860-09712fc894c5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:28.326372 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-05f3b5b2-f617-4068-a860-09712fc894c5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:28.335008 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-05f3b5b2-f617-4068-a860-09712fc894c5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1504 microversion: 2.1 time: 0.200062 Apr 12 00:28:28.335582 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 177/344] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:28 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:28.347198 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-17170228-7327-4320-93de-dc2c0b7d4a56 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:28.357410 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-17170228-7327-4320-93de-dc2c0b7d4a56 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.284172 Apr 12 00:28:28.357410 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 168/345] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:28 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:28.606710 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-93ef6c3c-ad7f-4451-8133-5ba9f490d95a req-5349173e-a9fa-4555-a634-a38ecda073b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6042349-8a44-497b-98eb-495d14a01504", "name": "network-vif-deleted", "tag": "5f52b226-528b-4264-91d2-43e3ee68cf0e"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:28:28.615370 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-93ef6c3c-ad7f-4451-8133-5ba9f490d95a req-5349173e-a9fa-4555-a634-a38ecda073b1 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:28.615974 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-93ef6c3c-ad7f-4451-8133-5ba9f490d95a req-5349173e-a9fa-4555-a634-a38ecda073b1 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:28.630712 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-93ef6c3c-ad7f-4451-8133-5ba9f490d95a req-5349173e-a9fa-4555-a634-a38ecda073b1 service nova] Creating event network-vif-deleted:5f52b226-528b-4264-91d2-43e3ee68cf0e for instance d6042349-8a44-497b-98eb-495d14a01504 on hv-cinder-83625 Apr 12 00:28:28.636926 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-93ef6c3c-ad7f-4451-8133-5ba9f490d95a req-5349173e-a9fa-4555-a634-a38ecda073b1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034498 Apr 12 00:28:28.637827 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 178/346] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:28:29.352431 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-638eba3e-2462-4d7d-bb45-3e1c68860eb8 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:29.353038 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-638eba3e-2462-4d7d-bb45-3e1c68860eb8 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:29.358862 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-638eba3e-2462-4d7d-bb45-3e1c68860eb8 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:29.359362 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-638eba3e-2462-4d7d-bb45-3e1c68860eb8 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:29.360117 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-638eba3e-2462-4d7d-bb45-3e1c68860eb8 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:29.360722 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-638eba3e-2462-4d7d-bb45-3e1c68860eb8 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:29.373518 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-174db580-7add-4472-99fa-09f404d114ed tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:29.375321 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-174db580-7add-4472-99fa-09f404d114ed tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:29.381363 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-174db580-7add-4472-99fa-09f404d114ed tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:29.381814 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-174db580-7add-4472-99fa-09f404d114ed tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:29.382744 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-174db580-7add-4472-99fa-09f404d114ed tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:29.383180 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-174db580-7add-4472-99fa-09f404d114ed tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:29.429405 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-638eba3e-2462-4d7d-bb45-3e1c68860eb8 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:29.442673 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-638eba3e-2462-4d7d-bb45-3e1c68860eb8 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1462 microversion: 2.1 time: 0.093957 Apr 12 00:28:29.443506 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 169/347] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:29 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1462 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:29.541922 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-174db580-7add-4472-99fa-09f404d114ed tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:29.544129 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-174db580-7add-4472-99fa-09f404d114ed tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.175450 Apr 12 00:28:29.544870 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 179/348] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:29 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:30.460065 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-6179870c-11ce-4a1f-bfe7-541de9eafa97 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:30.460854 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-6179870c-11ce-4a1f-bfe7-541de9eafa97 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:30.467232 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6179870c-11ce-4a1f-bfe7-541de9eafa97 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:30.467671 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6179870c-11ce-4a1f-bfe7-541de9eafa97 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:30.469507 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6179870c-11ce-4a1f-bfe7-541de9eafa97 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:30.470112 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6179870c-11ce-4a1f-bfe7-541de9eafa97 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:30.505804 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6179870c-11ce-4a1f-bfe7-541de9eafa97 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:30.506272 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6179870c-11ce-4a1f-bfe7-541de9eafa97 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:30.506723 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-6179870c-11ce-4a1f-bfe7-541de9eafa97 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid d6042349-8a44-497b-98eb-495d14a01504 {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:28:30.558232 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-6179870c-11ce-4a1f-bfe7-541de9eafa97 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:30.560790 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c263d037-6ff5-4ac3-a91e-2d1bea69417a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:30.561472 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c263d037-6ff5-4ac3-a91e-2d1bea69417a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:30.566693 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-6179870c-11ce-4a1f-bfe7-541de9eafa97 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 200 len: 1304 microversion: 2.1 time: 0.110852 Apr 12 00:28:30.567344 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 170/349] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:30 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:30.570288 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c263d037-6ff5-4ac3-a91e-2d1bea69417a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:30.570905 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c263d037-6ff5-4ac3-a91e-2d1bea69417a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:30.571676 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c263d037-6ff5-4ac3-a91e-2d1bea69417a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:30.572257 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c263d037-6ff5-4ac3-a91e-2d1bea69417a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:30.722431 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-c263d037-6ff5-4ac3-a91e-2d1bea69417a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:30.729979 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c263d037-6ff5-4ac3-a91e-2d1bea69417a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.173076 Apr 12 00:28:30.730842 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 180/350] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:30 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:31.584519 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-bcd3cc00-77dd-47c0-9135-c076b023dc51 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:31.586107 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-bcd3cc00-77dd-47c0-9135-c076b023dc51 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: d6042349-8a44-497b-98eb-495d14a01504] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:31.591562 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bcd3cc00-77dd-47c0-9135-c076b023dc51 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:31.592012 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bcd3cc00-77dd-47c0-9135-c076b023dc51 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:31.592772 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bcd3cc00-77dd-47c0-9135-c076b023dc51 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:31.593206 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bcd3cc00-77dd-47c0-9135-c076b023dc51 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:31.606274 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-bcd3cc00-77dd-47c0-9135-c076b023dc51 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] HTTP exception thrown: Instance d6042349-8a44-497b-98eb-495d14a01504 could not be found. Apr 12 00:28:31.606854 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-bcd3cc00-77dd-47c0-9135-c076b023dc51 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Returning 404 to user: Instance d6042349-8a44-497b-98eb-495d14a01504 could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:28:31.607666 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-bcd3cc00-77dd-47c0-9135-c076b023dc51 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504" status: 404 len: 111 microversion: 2.1 time: 0.027036 Apr 12 00:28:31.608197 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 171/351] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:31 2022] GET /compute/v2.1/servers/d6042349-8a44-497b-98eb-495d14a01504 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:28:31.716399 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-52c91881-3d83-4316-bc37-1759b3abffc5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1378218053", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452", "networks": [{"uuid": "2b113919-fa22-480a-8455-7a7b46c22169"}]}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:28:31.751197 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4a7b9e80-f354-4768-93cf-ee24acd255fa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:31.752382 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-4a7b9e80-f354-4768-93cf-ee24acd255fa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:31.767960 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4a7b9e80-f354-4768-93cf-ee24acd255fa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:31.769060 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4a7b9e80-f354-4768-93cf-ee24acd255fa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:31.771160 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4a7b9e80-f354-4768-93cf-ee24acd255fa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:31.771885 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4a7b9e80-f354-4768-93cf-ee24acd255fa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:31.772881 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.network.neutron [None req-52c91881-3d83-4316-bc37-1759b3abffc5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] validate_networks() for [('2b113919-fa22-480a-8455-7a7b46c22169', None, None, None, None, None)] {{(pid=128486) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:28:31.976840 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-4a7b9e80-f354-4768-93cf-ee24acd255fa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:31.987717 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-4a7b9e80-f354-4768-93cf-ee24acd255fa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.244650 Apr 12 00:28:31.988293 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 172/352] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:31 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:32.219594 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-52c91881-3d83-4316-bc37-1759b3abffc5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Flavor limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:28:32.220405 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-52c91881-3d83-4316-bc37-1759b3abffc5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Image limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:28:32.221039 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-52c91881-3d83-4316-bc37-1759b3abffc5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Flavor pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:28:32.221596 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-52c91881-3d83-4316-bc37-1759b3abffc5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Image pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:28:32.227758 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-52c91881-3d83-4316-bc37-1759b3abffc5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:28:32.244887 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-52c91881-3d83-4316-bc37-1759b3abffc5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:32.245300 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-52c91881-3d83-4316-bc37-1759b3abffc5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:32.246136 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-52c91881-3d83-4316-bc37-1759b3abffc5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:32.246608 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-52c91881-3d83-4316-bc37-1759b3abffc5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:32.264508 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-52c91881-3d83-4316-bc37-1759b3abffc5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Getting quotas for project c67b239e9580469aaa5714c21a4c590d. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:28:32.270165 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-52c91881-3d83-4316-bc37-1759b3abffc5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Getting quotas for user f1db4aee3a4d43ccb111eb7ede0510d9 and project c67b239e9580469aaa5714c21a4c590d. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:28:32.283227 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-52c91881-3d83-4316-bc37-1759b3abffc5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Going to run 1 instances... {{(pid=128486) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:28:32.285909 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-52c91881-3d83-4316-bc37-1759b3abffc5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:28:32.335909 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-52c91881-3d83-4316-bc37-1759b3abffc5 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623367 Apr 12 00:28:32.336551 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 181/353] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:28:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:28:32.347417 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-bd0d2f27-89d0-481b-baf0-75e337b6039c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:32.348360 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-bd0d2f27-89d0-481b-baf0-75e337b6039c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:32.458564 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-bd0d2f27-89d0-481b-baf0-75e337b6039c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:32.470132 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-bd0d2f27-89d0-481b-baf0-75e337b6039c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1214 microversion: 2.1 time: 0.127160 Apr 12 00:28:32.471144 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 173/354] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:32 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1214 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:33.004822 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c8041843-447c-45b0-ae36-12e275c83b30 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:33.005463 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c8041843-447c-45b0-ae36-12e275c83b30 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:33.013279 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c8041843-447c-45b0-ae36-12e275c83b30 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:33.013728 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c8041843-447c-45b0-ae36-12e275c83b30 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:33.014519 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c8041843-447c-45b0-ae36-12e275c83b30 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:33.015024 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c8041843-447c-45b0-ae36-12e275c83b30 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:33.195135 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-c8041843-447c-45b0-ae36-12e275c83b30 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:33.205661 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c8041843-447c-45b0-ae36-12e275c83b30 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.204284 Apr 12 00:28:33.206540 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 182/355] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:32 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:33.488811 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2ea43e41-cf80-4ee0-8075-c298e8944d87 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:33.490032 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2ea43e41-cf80-4ee0-8075-c298e8944d87 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:33.497240 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2ea43e41-cf80-4ee0-8075-c298e8944d87 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:33.497929 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2ea43e41-cf80-4ee0-8075-c298e8944d87 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:33.498952 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2ea43e41-cf80-4ee0-8075-c298e8944d87 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:33.500114 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2ea43e41-cf80-4ee0-8075-c298e8944d87 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:33.568707 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2ea43e41-cf80-4ee0-8075-c298e8944d87 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:33.576622 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2ea43e41-cf80-4ee0-8075-c298e8944d87 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1266 microversion: 2.1 time: 0.093789 Apr 12 00:28:33.577391 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 174/356] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:33 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:34.223943 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4823b6ab-7508-49bb-a597-f71d3b7e0ccf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:34.224844 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4823b6ab-7508-49bb-a597-f71d3b7e0ccf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:34.231473 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4823b6ab-7508-49bb-a597-f71d3b7e0ccf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:34.231927 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4823b6ab-7508-49bb-a597-f71d3b7e0ccf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:34.232723 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4823b6ab-7508-49bb-a597-f71d3b7e0ccf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:34.233376 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4823b6ab-7508-49bb-a597-f71d3b7e0ccf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:34.387720 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4823b6ab-7508-49bb-a597-f71d3b7e0ccf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:34.403958 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4823b6ab-7508-49bb-a597-f71d3b7e0ccf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1503 microversion: 2.1 time: 0.183812 Apr 12 00:28:34.405345 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 183/357] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:34 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:34.421738 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5181ae17-3500-45a9-af85-182ab3b12915 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26a25169-9b22-46c4-ba31-9adf49cf4423"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:28:34.423178 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5181ae17-3500-45a9-af85-182ab3b12915 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:34.430023 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5181ae17-3500-45a9-af85-182ab3b12915 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:34.430873 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5181ae17-3500-45a9-af85-182ab3b12915 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:34.431871 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5181ae17-3500-45a9-af85-182ab3b12915 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:34.432506 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5181ae17-3500-45a9-af85-182ab3b12915 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:34.458306 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-5181ae17-3500-45a9-af85-182ab3b12915 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] HTTP exception thrown: Cannot 'attach_volume' instance 1f7526a5-050f-4c25-8432-e85eddf41b98 while it is in vm_state rescued Apr 12 00:28:34.459164 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5181ae17-3500-45a9-af85-182ab3b12915 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Returning 409 to user: Cannot 'attach_volume' instance 1f7526a5-050f-4c25-8432-e85eddf41b98 while it is in vm_state rescued {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:28:34.460285 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5181ae17-3500-45a9-af85-182ab3b12915 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "POST /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042940 Apr 12 00:28:34.460964 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 175/358] 10.222.0.32 () {60 vars in 1322 bytes} [Tue Apr 12 00:28:34 2022] POST /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 00:28:34.471257 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e7d4097d-5bd8-4472-af6f-67d75f5a60a3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:28:34.471779 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e7d4097d-5bd8-4472-af6f-67d75f5a60a3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:34.479950 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e7d4097d-5bd8-4472-af6f-67d75f5a60a3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:34.480414 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e7d4097d-5bd8-4472-af6f-67d75f5a60a3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:34.481265 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e7d4097d-5bd8-4472-af6f-67d75f5a60a3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:34.481738 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e7d4097d-5bd8-4472-af6f-67d75f5a60a3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:34.595443 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e7926e29-c529-4e11-b53a-065881b6de8e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:34.596103 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e7926e29-c529-4e11-b53a-065881b6de8e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:34.602552 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e7926e29-c529-4e11-b53a-065881b6de8e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:34.604395 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e7926e29-c529-4e11-b53a-065881b6de8e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:34.606223 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e7926e29-c529-4e11-b53a-065881b6de8e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:34.607083 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e7926e29-c529-4e11-b53a-065881b6de8e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:34.634123 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e7d4097d-5bd8-4472-af6f-67d75f5a60a3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "POST /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98/action" status: 202 len: 0 microversion: 2.1 time: 0.167089 Apr 12 00:28:34.637736 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 184/359] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Apr 12 00:28:34 2022] POST /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:28:34.651639 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-904ba81d-fae3-4a2f-afcb-153dcedbd899 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:34.652923 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-904ba81d-fae3-4a2f-afcb-153dcedbd899 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:34.674323 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-904ba81d-fae3-4a2f-afcb-153dcedbd899 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:34.674976 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-904ba81d-fae3-4a2f-afcb-153dcedbd899 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:34.675925 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-904ba81d-fae3-4a2f-afcb-153dcedbd899 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:34.676521 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-904ba81d-fae3-4a2f-afcb-153dcedbd899 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:34.849267 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-904ba81d-fae3-4a2f-afcb-153dcedbd899 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:34.858230 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-904ba81d-fae3-4a2f-afcb-153dcedbd899 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1511 microversion: 2.1 time: 0.214383 Apr 12 00:28:34.859464 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 185/360] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:34 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:35.002065 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e7926e29-c529-4e11-b53a-065881b6de8e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:35.012006 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e7926e29-c529-4e11-b53a-065881b6de8e tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1314 microversion: 2.1 time: 0.421293 Apr 12 00:28:35.013147 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 176/361] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:34 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:35.846041 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-f9b5d36c-eb97-41da-89e3-767f2d6f2a34 req-7691de05-b635-4a8c-81cc-e0011890e9cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13fbcf24-3a0e-4e17-bb4b-902364ee86db", "tag": "4d87f86a-c5c3-4dac-8e53-78bd55c3da76"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:28:35.854744 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-f9b5d36c-eb97-41da-89e3-767f2d6f2a34 req-7691de05-b635-4a8c-81cc-e0011890e9cd service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:35.855185 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-f9b5d36c-eb97-41da-89e3-767f2d6f2a34 req-7691de05-b635-4a8c-81cc-e0011890e9cd service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:35.866636 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-f9b5d36c-eb97-41da-89e3-767f2d6f2a34 req-7691de05-b635-4a8c-81cc-e0011890e9cd service nova] Creating event network-changed:4d87f86a-c5c3-4dac-8e53-78bd55c3da76 for instance 13fbcf24-3a0e-4e17-bb4b-902364ee86db on hv-cinder-83625 Apr 12 00:28:35.873040 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-f9b5d36c-eb97-41da-89e3-767f2d6f2a34 req-7691de05-b635-4a8c-81cc-e0011890e9cd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031060 Apr 12 00:28:35.873922 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 186/362] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:28:35.875853 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f7460fbf-dd5f-4647-a5aa-74ed68abe1bd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:35.876566 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f7460fbf-dd5f-4647-a5aa-74ed68abe1bd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:35.882554 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f7460fbf-dd5f-4647-a5aa-74ed68abe1bd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:35.883007 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f7460fbf-dd5f-4647-a5aa-74ed68abe1bd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:35.883756 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f7460fbf-dd5f-4647-a5aa-74ed68abe1bd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:35.884184 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f7460fbf-dd5f-4647-a5aa-74ed68abe1bd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:36.029527 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-451dd460-bf46-4bbc-84e8-9490905764b9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:36.030217 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-451dd460-bf46-4bbc-84e8-9490905764b9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:36.036665 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-451dd460-bf46-4bbc-84e8-9490905764b9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:36.037113 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-451dd460-bf46-4bbc-84e8-9490905764b9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:36.037869 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-451dd460-bf46-4bbc-84e8-9490905764b9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:36.038341 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-451dd460-bf46-4bbc-84e8-9490905764b9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:36.041860 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f7460fbf-dd5f-4647-a5aa-74ed68abe1bd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:36.049658 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f7460fbf-dd5f-4647-a5aa-74ed68abe1bd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1511 microversion: 2.1 time: 0.177722 Apr 12 00:28:36.050225 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 177/363] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:35 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:36.169275 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-451dd460-bf46-4bbc-84e8-9490905764b9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:36.176390 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-451dd460-bf46-4bbc-84e8-9490905764b9 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1314 microversion: 2.1 time: 0.150989 Apr 12 00:28:36.176952 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 187/364] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:36 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:36.757077 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-0b9023cd-f301-4093-9e50-84d124a1ea69 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "345595e2-ce3c-427a-84b0-c9cdd8adfe13", "device": "/dev/sdb"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:28:36.758691 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-0b9023cd-f301-4093-9e50-84d124a1ea69 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:36.766634 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b9023cd-f301-4093-9e50-84d124a1ea69 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:36.768426 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b9023cd-f301-4093-9e50-84d124a1ea69 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:36.769400 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b9023cd-f301-4093-9e50-84d124a1ea69 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:36.770025 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b9023cd-f301-4093-9e50-84d124a1ea69 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:37.067093 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3a09879e-5e3f-4e4a-b4f8-e5d2053062d5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:37.067680 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3a09879e-5e3f-4e4a-b4f8-e5d2053062d5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:37.073883 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3a09879e-5e3f-4e4a-b4f8-e5d2053062d5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:37.074378 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3a09879e-5e3f-4e4a-b4f8-e5d2053062d5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:37.075140 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3a09879e-5e3f-4e4a-b4f8-e5d2053062d5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:37.075576 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3a09879e-5e3f-4e4a-b4f8-e5d2053062d5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:37.207987 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3a09879e-5e3f-4e4a-b4f8-e5d2053062d5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:37.215161 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3a09879e-5e3f-4e4a-b4f8-e5d2053062d5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1511 microversion: 2.1 time: 0.151871 Apr 12 00:28:37.215723 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 188/365] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:37 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:37.220009 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-73ceb5b1-8d4a-43e4-b407-ca060a530bd3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:37.220620 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-73ceb5b1-8d4a-43e4-b407-ca060a530bd3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:37.229533 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-73ceb5b1-8d4a-43e4-b407-ca060a530bd3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:37.229860 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-73ceb5b1-8d4a-43e4-b407-ca060a530bd3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:37.230643 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-73ceb5b1-8d4a-43e4-b407-ca060a530bd3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:37.231073 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-73ceb5b1-8d4a-43e4-b407-ca060a530bd3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:37.363758 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-73ceb5b1-8d4a-43e4-b407-ca060a530bd3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:37.370882 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-73ceb5b1-8d4a-43e4-b407-ca060a530bd3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1314 microversion: 2.1 time: 0.154237 Apr 12 00:28:37.371436 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 189/366] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:37 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:38.184859 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-0b9023cd-f301-4093-9e50-84d124a1ea69 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "POST /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.431367 Apr 12 00:28:38.185504 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 178/367] 10.222.0.32 () {60 vars in 1322 bytes} [Tue Apr 12 00:28:36 2022] POST /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983/os-volume_attachments => generated 194 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:28:38.232023 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4568a327-f608-4899-9173-5c4036b9aaba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:38.232777 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4568a327-f608-4899-9173-5c4036b9aaba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:38.240013 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4568a327-f608-4899-9173-5c4036b9aaba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:38.240468 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4568a327-f608-4899-9173-5c4036b9aaba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:38.241286 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4568a327-f608-4899-9173-5c4036b9aaba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:38.242028 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4568a327-f608-4899-9173-5c4036b9aaba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:38.370555 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4568a327-f608-4899-9173-5c4036b9aaba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:38.377776 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4568a327-f608-4899-9173-5c4036b9aaba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1511 microversion: 2.1 time: 0.149544 Apr 12 00:28:38.378361 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 190/368] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:38 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:38.393181 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5d939478-46a3-4b8c-a546-c008a567ccee tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:38.393984 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5d939478-46a3-4b8c-a546-c008a567ccee tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:38.403336 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5d939478-46a3-4b8c-a546-c008a567ccee tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:38.403854 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5d939478-46a3-4b8c-a546-c008a567ccee tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:38.404824 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5d939478-46a3-4b8c-a546-c008a567ccee tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:38.405427 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5d939478-46a3-4b8c-a546-c008a567ccee tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:38.554246 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-5d939478-46a3-4b8c-a546-c008a567ccee tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:38.561486 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5d939478-46a3-4b8c-a546-c008a567ccee tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1314 microversion: 2.1 time: 0.173675 Apr 12 00:28:38.562092 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 179/369] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:38 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:39.395300 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7165f7fa-c009-4f18-b817-ffbe06ad47ba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:39.396092 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7165f7fa-c009-4f18-b817-ffbe06ad47ba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:39.403230 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7165f7fa-c009-4f18-b817-ffbe06ad47ba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:39.403922 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7165f7fa-c009-4f18-b817-ffbe06ad47ba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:39.404972 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7165f7fa-c009-4f18-b817-ffbe06ad47ba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:39.405697 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7165f7fa-c009-4f18-b817-ffbe06ad47ba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:39.579119 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-85dd4f73-498e-432f-a182-9421c0056211 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:39.580821 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-85dd4f73-498e-432f-a182-9421c0056211 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:39.589233 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7165f7fa-c009-4f18-b817-ffbe06ad47ba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:39.597560 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-85dd4f73-498e-432f-a182-9421c0056211 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:39.599216 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-85dd4f73-498e-432f-a182-9421c0056211 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:39.601101 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-85dd4f73-498e-432f-a182-9421c0056211 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:39.602042 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-85dd4f73-498e-432f-a182-9421c0056211 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:39.606783 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7165f7fa-c009-4f18-b817-ffbe06ad47ba tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1517 microversion: 2.1 time: 0.214892 Apr 12 00:28:39.608214 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 191/370] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:39 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1517 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:39.782428 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-85dd4f73-498e-432f-a182-9421c0056211 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:39.790565 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-85dd4f73-498e-432f-a182-9421c0056211 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1314 microversion: 2.1 time: 0.216498 Apr 12 00:28:39.791136 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 180/371] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:39 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:40.807148 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b4f6fc57-ff15-47e1-9e8f-7eda9a8efa2b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:40.807687 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b4f6fc57-ff15-47e1-9e8f-7eda9a8efa2b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:40.814401 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b4f6fc57-ff15-47e1-9e8f-7eda9a8efa2b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:40.814850 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b4f6fc57-ff15-47e1-9e8f-7eda9a8efa2b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:40.815605 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b4f6fc57-ff15-47e1-9e8f-7eda9a8efa2b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:40.816034 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b4f6fc57-ff15-47e1-9e8f-7eda9a8efa2b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:40.941808 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b4f6fc57-ff15-47e1-9e8f-7eda9a8efa2b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:40.949067 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b4f6fc57-ff15-47e1-9e8f-7eda9a8efa2b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1314 microversion: 2.1 time: 0.145763 Apr 12 00:28:40.949634 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 192/372] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:40 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:41.967852 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-26a4f98c-d782-4cbc-9c07-2db184463e3a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:41.969187 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-26a4f98c-d782-4cbc-9c07-2db184463e3a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:41.976898 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-26a4f98c-d782-4cbc-9c07-2db184463e3a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:41.977451 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-26a4f98c-d782-4cbc-9c07-2db184463e3a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:41.984730 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-26a4f98c-d782-4cbc-9c07-2db184463e3a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:41.985390 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-26a4f98c-d782-4cbc-9c07-2db184463e3a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:42.047525 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3feb6cae-90ea-4e05-86ba-b63fce40e6fa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Action: 'create', calling method: .version_select at 0x7f64e12cbc10>, body: {"keypair": {"name": "tempest-keypair-476237608"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:28:42.061521 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-3feb6cae-90ea-4e05-86ba-b63fce40e6fa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Getting quotas for project 7bdba79df5fc4c3faa187bd65479d3f7. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:28:42.065934 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-3feb6cae-90ea-4e05-86ba-b63fce40e6fa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Getting quotas for user b434038833084579adf853df718315b2 and project 7bdba79df5fc4c3faa187bd65479d3f7. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:28:42.405034 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-26a4f98c-d782-4cbc-9c07-2db184463e3a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:42.416547 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-26a4f98c-d782-4cbc-9c07-2db184463e3a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1314 microversion: 2.1 time: 0.454378 Apr 12 00:28:42.427799 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-3feb6cae-90ea-4e05-86ba-b63fce40e6fa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Getting quotas for project 7bdba79df5fc4c3faa187bd65479d3f7. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:28:42.428244 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 181/373] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:41 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:42.453188 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-3feb6cae-90ea-4e05-86ba-b63fce40e6fa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Getting quotas for user b434038833084579adf853df718315b2 and project 7bdba79df5fc4c3faa187bd65479d3f7. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:28:42.488846 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3feb6cae-90ea-4e05-86ba-b63fce40e6fa tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.445078 Apr 12 00:28:42.491692 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 193/374] 10.222.0.32 () {60 vars in 1157 bytes} [Tue Apr 12 00:28:42 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:43.444111 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-24525699-804a-43ce-8030-6940c68f4a9b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:43.445289 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-24525699-804a-43ce-8030-6940c68f4a9b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:43.452511 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-24525699-804a-43ce-8030-6940c68f4a9b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:43.453156 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-24525699-804a-43ce-8030-6940c68f4a9b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:43.454306 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-24525699-804a-43ce-8030-6940c68f4a9b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:43.454746 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-24525699-804a-43ce-8030-6940c68f4a9b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:43.637498 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-24525699-804a-43ce-8030-6940c68f4a9b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:43.646148 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-24525699-804a-43ce-8030-6940c68f4a9b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1314 microversion: 2.1 time: 0.205554 Apr 12 00:28:43.659820 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 182/375] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:43 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:44.017828 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1dcfd820-6cf1-4e1d-a62e-f5b709c89c97 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-493250119", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d9c3b5d9-2a62-4930-bf1a-06e919287728"}], "security_groups": [{"name": "tempest-securitygroup--1684190543"}], "key_name": "tempest-keypair-476237608", "user_data": "}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:28:44.122088 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.network.neutron [None req-1dcfd820-6cf1-4e1d-a62e-f5b709c89c97 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] validate_networks() for [('d9c3b5d9-2a62-4930-bf1a-06e919287728', None, None, None, None, None)] {{(pid=128486) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:28:44.371957 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-8814d133-d356-424f-ba9c-7f32b233284a req-9896bf6c-6a64-4bfb-894e-ca44f61ec014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13fbcf24-3a0e-4e17-bb4b-902364ee86db", "name": "network-vif-plugged", "status": "completed", "tag": "4d87f86a-c5c3-4dac-8e53-78bd55c3da76"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:28:44.384097 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-8814d133-d356-424f-ba9c-7f32b233284a req-9896bf6c-6a64-4bfb-894e-ca44f61ec014 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:44.385632 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-8814d133-d356-424f-ba9c-7f32b233284a req-9896bf6c-6a64-4bfb-894e-ca44f61ec014 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:44.404476 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-8814d133-d356-424f-ba9c-7f32b233284a req-9896bf6c-6a64-4bfb-894e-ca44f61ec014 service nova] Creating event network-vif-plugged:4d87f86a-c5c3-4dac-8e53-78bd55c3da76 for instance 13fbcf24-3a0e-4e17-bb4b-902364ee86db on hv-cinder-83625 Apr 12 00:28:44.410425 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-8814d133-d356-424f-ba9c-7f32b233284a req-9896bf6c-6a64-4bfb-894e-ca44f61ec014 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041618 Apr 12 00:28:44.411116 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 183/376] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:28:44.676979 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-89a03555-a1a0-4647-9d20-995d1cd4b62b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:44.679359 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-89a03555-a1a0-4647-9d20-995d1cd4b62b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:44.695448 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-89a03555-a1a0-4647-9d20-995d1cd4b62b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:44.696525 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-89a03555-a1a0-4647-9d20-995d1cd4b62b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:44.697314 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-89a03555-a1a0-4647-9d20-995d1cd4b62b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:44.697922 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-89a03555-a1a0-4647-9d20-995d1cd4b62b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:44.731287 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-1dcfd820-6cf1-4e1d-a62e-f5b709c89c97 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Flavor limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:28:44.731819 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-1dcfd820-6cf1-4e1d-a62e-f5b709c89c97 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Image limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:28:44.732414 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-1dcfd820-6cf1-4e1d-a62e-f5b709c89c97 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Flavor pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:28:44.733157 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-1dcfd820-6cf1-4e1d-a62e-f5b709c89c97 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Image pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:28:44.733711 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-1dcfd820-6cf1-4e1d-a62e-f5b709c89c97 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:28:44.742971 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1dcfd820-6cf1-4e1d-a62e-f5b709c89c97 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:44.743704 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1dcfd820-6cf1-4e1d-a62e-f5b709c89c97 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:44.744619 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1dcfd820-6cf1-4e1d-a62e-f5b709c89c97 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:44.745140 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1dcfd820-6cf1-4e1d-a62e-f5b709c89c97 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:44.762330 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-1dcfd820-6cf1-4e1d-a62e-f5b709c89c97 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Getting quotas for project 7bdba79df5fc4c3faa187bd65479d3f7. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:28:44.767023 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-1dcfd820-6cf1-4e1d-a62e-f5b709c89c97 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Getting quotas for user b434038833084579adf853df718315b2 and project 7bdba79df5fc4c3faa187bd65479d3f7. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:28:44.779558 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1dcfd820-6cf1-4e1d-a62e-f5b709c89c97 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Going to run 1 instances... {{(pid=128486) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:28:44.782227 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1dcfd820-6cf1-4e1d-a62e-f5b709c89c97 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:28:44.833588 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1dcfd820-6cf1-4e1d-a62e-f5b709c89c97 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.821126 Apr 12 00:28:44.839308 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 194/377] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:28:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:28:44.845759 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-499fe123-7a7b-429f-9f37-ff3a40f393fb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:44.846413 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-499fe123-7a7b-429f-9f37-ff3a40f393fb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:44.863968 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-89a03555-a1a0-4647-9d20-995d1cd4b62b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:44.873014 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-89a03555-a1a0-4647-9d20-995d1cd4b62b tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1314 microversion: 2.1 time: 0.202006 Apr 12 00:28:44.875416 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 184/378] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:44 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:44.919957 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-499fe123-7a7b-429f-9f37-ff3a40f393fb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:44.928963 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-499fe123-7a7b-429f-9f37-ff3a40f393fb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1244 microversion: 2.1 time: 0.088027 Apr 12 00:28:44.929514 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 195/379] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:44 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:45.891550 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a58b018b-8f7f-4ea1-8a97-a1b3ea6767e3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:45.892188 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a58b018b-8f7f-4ea1-8a97-a1b3ea6767e3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:45.898737 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a58b018b-8f7f-4ea1-8a97-a1b3ea6767e3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:45.899176 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a58b018b-8f7f-4ea1-8a97-a1b3ea6767e3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:45.899924 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a58b018b-8f7f-4ea1-8a97-a1b3ea6767e3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:45.900349 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a58b018b-8f7f-4ea1-8a97-a1b3ea6767e3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:45.946693 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8b6c0cf8-eafb-48d8-84b8-5d69a8fcb85f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:45.947405 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8b6c0cf8-eafb-48d8-84b8-5d69a8fcb85f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:45.954176 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8b6c0cf8-eafb-48d8-84b8-5d69a8fcb85f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:45.954654 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8b6c0cf8-eafb-48d8-84b8-5d69a8fcb85f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:45.955405 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8b6c0cf8-eafb-48d8-84b8-5d69a8fcb85f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:45.955836 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8b6c0cf8-eafb-48d8-84b8-5d69a8fcb85f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:46.030192 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8b6c0cf8-eafb-48d8-84b8-5d69a8fcb85f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:46.037749 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8b6c0cf8-eafb-48d8-84b8-5d69a8fcb85f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1240 microversion: 2.1 time: 0.095131 Apr 12 00:28:46.038352 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 196/380] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:45 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:46.050529 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a58b018b-8f7f-4ea1-8a97-a1b3ea6767e3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:46.072906 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a58b018b-8f7f-4ea1-8a97-a1b3ea6767e3 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1314 microversion: 2.1 time: 0.185655 Apr 12 00:28:46.074651 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 185/381] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:45 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:47.056081 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-bbe3df72-9b53-4776-8516-bb39fc42d569 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:47.056594 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-bbe3df72-9b53-4776-8516-bb39fc42d569 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:47.063218 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bbe3df72-9b53-4776-8516-bb39fc42d569 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:47.063666 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bbe3df72-9b53-4776-8516-bb39fc42d569 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:47.064422 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bbe3df72-9b53-4776-8516-bb39fc42d569 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:47.064851 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bbe3df72-9b53-4776-8516-bb39fc42d569 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:47.094915 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-519654af-2e47-4f2a-a9fd-7d0555c00324 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:47.095384 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-519654af-2e47-4f2a-a9fd-7d0555c00324 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:47.107613 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-519654af-2e47-4f2a-a9fd-7d0555c00324 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:47.108066 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-519654af-2e47-4f2a-a9fd-7d0555c00324 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:47.108841 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-519654af-2e47-4f2a-a9fd-7d0555c00324 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:47.109274 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-519654af-2e47-4f2a-a9fd-7d0555c00324 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:47.133198 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-bbe3df72-9b53-4776-8516-bb39fc42d569 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:47.141258 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-bbe3df72-9b53-4776-8516-bb39fc42d569 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1304 microversion: 2.1 time: 0.089052 Apr 12 00:28:47.141829 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 197/382] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:47 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:47.302331 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-519654af-2e47-4f2a-a9fd-7d0555c00324 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:47.311218 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-519654af-2e47-4f2a-a9fd-7d0555c00324 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1498 microversion: 2.1 time: 0.221362 Apr 12 00:28:47.321691 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 186/383] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:47 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1498 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:47.929994 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-11b458d8-774e-40f9-a91f-48caf2af04b1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:47.930994 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-11b458d8-774e-40f9-a91f-48caf2af04b1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:47.939147 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-11b458d8-774e-40f9-a91f-48caf2af04b1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:47.940086 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-11b458d8-774e-40f9-a91f-48caf2af04b1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:47.941479 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-11b458d8-774e-40f9-a91f-48caf2af04b1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:47.942228 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-11b458d8-774e-40f9-a91f-48caf2af04b1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:47.977386 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-11b458d8-774e-40f9-a91f-48caf2af04b1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Going to try to terminate instance {{(pid=128486) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:28:48.102973 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-11b458d8-774e-40f9-a91f-48caf2af04b1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "DELETE /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 204 len: 0 microversion: 2.1 time: 0.177261 Apr 12 00:28:48.105237 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 198/384] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:28:47 2022] DELETE /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:28:48.113875 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a82c13c9-26c9-4d5e-b6f8-e39e2d98b446 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:48.114501 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a82c13c9-26c9-4d5e-b6f8-e39e2d98b446 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:48.130305 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a82c13c9-26c9-4d5e-b6f8-e39e2d98b446 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:48.131495 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a82c13c9-26c9-4d5e-b6f8-e39e2d98b446 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:48.132398 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a82c13c9-26c9-4d5e-b6f8-e39e2d98b446 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:48.132989 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a82c13c9-26c9-4d5e-b6f8-e39e2d98b446 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:48.167649 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ce616f1d-9e5a-4117-9958-c516e2b3f780 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:48.168344 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ce616f1d-9e5a-4117-9958-c516e2b3f780 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:48.187995 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ce616f1d-9e5a-4117-9958-c516e2b3f780 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:48.188448 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ce616f1d-9e5a-4117-9958-c516e2b3f780 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:48.189222 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ce616f1d-9e5a-4117-9958-c516e2b3f780 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:48.189654 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ce616f1d-9e5a-4117-9958-c516e2b3f780 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:48.405235 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ce616f1d-9e5a-4117-9958-c516e2b3f780 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:48.414521 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ce616f1d-9e5a-4117-9958-c516e2b3f780 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.258875 Apr 12 00:28:48.416313 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 199/385] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:48 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:48.466028 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a82c13c9-26c9-4d5e-b6f8-e39e2d98b446 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:48.477809 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a82c13c9-26c9-4d5e-b6f8-e39e2d98b446 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1504 microversion: 2.1 time: 0.367911 Apr 12 00:28:48.478639 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 187/386] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:48 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1504 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:49.432793 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0a06e4a4-4b37-4b12-99bd-dda137711b35 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:49.433397 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0a06e4a4-4b37-4b12-99bd-dda137711b35 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:49.440189 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0a06e4a4-4b37-4b12-99bd-dda137711b35 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:49.440631 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0a06e4a4-4b37-4b12-99bd-dda137711b35 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:49.441390 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0a06e4a4-4b37-4b12-99bd-dda137711b35 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:49.441827 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0a06e4a4-4b37-4b12-99bd-dda137711b35 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:49.495346 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2de2de03-2f83-4ffa-9438-bd76032c759a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:49.496671 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2de2de03-2f83-4ffa-9438-bd76032c759a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:49.505432 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2de2de03-2f83-4ffa-9438-bd76032c759a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:49.506142 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2de2de03-2f83-4ffa-9438-bd76032c759a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:49.507103 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2de2de03-2f83-4ffa-9438-bd76032c759a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:49.507579 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2de2de03-2f83-4ffa-9438-bd76032c759a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:49.577824 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0a06e4a4-4b37-4b12-99bd-dda137711b35 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:49.585225 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0a06e4a4-4b37-4b12-99bd-dda137711b35 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.156171 Apr 12 00:28:49.585852 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 200/387] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:49 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:49.778320 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2de2de03-2f83-4ffa-9438-bd76032c759a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:49.787965 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2de2de03-2f83-4ffa-9438-bd76032c759a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1504 microversion: 2.1 time: 0.296276 Apr 12 00:28:49.789196 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 188/388] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:49 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:50.148688 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-748378d0-e101-4e64-94bf-6a17897c5746 req-3b2051f6-c8a8-4e2a-bc42-29650d2ed041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a3e7dc-86c5-42ab-8a46-126c80dd1adc", "tag": "acbbc313-dcc4-4731-a931-77e1a5d10277"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:28:50.164080 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-748378d0-e101-4e64-94bf-6a17897c5746 req-3b2051f6-c8a8-4e2a-bc42-29650d2ed041 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:50.164829 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-748378d0-e101-4e64-94bf-6a17897c5746 req-3b2051f6-c8a8-4e2a-bc42-29650d2ed041 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:50.193047 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-748378d0-e101-4e64-94bf-6a17897c5746 req-3b2051f6-c8a8-4e2a-bc42-29650d2ed041 service nova] Creating event network-changed:acbbc313-dcc4-4731-a931-77e1a5d10277 for instance 85a3e7dc-86c5-42ab-8a46-126c80dd1adc on hv-cinder-83625 Apr 12 00:28:50.206370 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-748378d0-e101-4e64-94bf-6a17897c5746 req-3b2051f6-c8a8-4e2a-bc42-29650d2ed041 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063081 Apr 12 00:28:50.210319 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 201/389] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:28:50.603981 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-7eaa00dd-d81f-4cea-bcda-46f534b03f63 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:50.605268 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-7eaa00dd-d81f-4cea-bcda-46f534b03f63 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:50.612231 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7eaa00dd-d81f-4cea-bcda-46f534b03f63 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:50.612928 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7eaa00dd-d81f-4cea-bcda-46f534b03f63 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:50.613876 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7eaa00dd-d81f-4cea-bcda-46f534b03f63 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:50.614720 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7eaa00dd-d81f-4cea-bcda-46f534b03f63 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:50.805882 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ce926927-455c-4acd-a8d0-f9f4f3cadcd1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:50.806617 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ce926927-455c-4acd-a8d0-f9f4f3cadcd1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:50.812884 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ce926927-455c-4acd-a8d0-f9f4f3cadcd1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:50.813327 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ce926927-455c-4acd-a8d0-f9f4f3cadcd1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:50.814085 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ce926927-455c-4acd-a8d0-f9f4f3cadcd1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:50.814724 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ce926927-455c-4acd-a8d0-f9f4f3cadcd1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:50.861537 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-7eaa00dd-d81f-4cea-bcda-46f534b03f63 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:50.869579 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-7eaa00dd-d81f-4cea-bcda-46f534b03f63 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.269494 Apr 12 00:28:50.871111 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 189/390] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:50 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:51.026682 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ce926927-455c-4acd-a8d0-f9f4f3cadcd1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:51.035209 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ce926927-455c-4acd-a8d0-f9f4f3cadcd1 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1504 microversion: 2.1 time: 0.233881 Apr 12 00:28:51.036119 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 202/391] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:50 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:51.888080 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5395d06b-1947-410f-ad4d-0fbdc629d1f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:51.889375 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5395d06b-1947-410f-ad4d-0fbdc629d1f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:51.896266 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5395d06b-1947-410f-ad4d-0fbdc629d1f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:51.897745 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5395d06b-1947-410f-ad4d-0fbdc629d1f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:51.899055 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5395d06b-1947-410f-ad4d-0fbdc629d1f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:51.899703 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5395d06b-1947-410f-ad4d-0fbdc629d1f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:52.054141 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-48b3dd66-96d3-4770-8420-7aebacddd042 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:52.055003 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-48b3dd66-96d3-4770-8420-7aebacddd042 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:52.063459 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-5395d06b-1947-410f-ad4d-0fbdc629d1f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:52.064775 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48b3dd66-96d3-4770-8420-7aebacddd042 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:52.066056 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48b3dd66-96d3-4770-8420-7aebacddd042 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:52.067260 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48b3dd66-96d3-4770-8420-7aebacddd042 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:52.067874 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48b3dd66-96d3-4770-8420-7aebacddd042 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:52.072576 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5395d06b-1947-410f-ad4d-0fbdc629d1f0 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.188113 Apr 12 00:28:52.073587 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 190/392] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:51 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:52.106855 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48b3dd66-96d3-4770-8420-7aebacddd042 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:52.107308 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48b3dd66-96d3-4770-8420-7aebacddd042 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:52.107766 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-48b3dd66-96d3-4770-8420-7aebacddd042 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:28:52.188859 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-48b3dd66-96d3-4770-8420-7aebacddd042 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:52.196405 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-48b3dd66-96d3-4770-8420-7aebacddd042 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.147474 Apr 12 00:28:52.197416 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 203/393] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:52 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:52.246016 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-f04a8a90-db75-44e6-b057-29e131b80ebd req-ad59ea27-cdfd-4baf-a960-19a12d470189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13fbcf24-3a0e-4e17-bb4b-902364ee86db", "name": "network-vif-deleted", "tag": "4d87f86a-c5c3-4dac-8e53-78bd55c3da76"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:28:52.254874 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-f04a8a90-db75-44e6-b057-29e131b80ebd req-ad59ea27-cdfd-4baf-a960-19a12d470189 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:52.255437 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-f04a8a90-db75-44e6-b057-29e131b80ebd req-ad59ea27-cdfd-4baf-a960-19a12d470189 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:52.268022 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-f04a8a90-db75-44e6-b057-29e131b80ebd req-ad59ea27-cdfd-4baf-a960-19a12d470189 service nova] Creating event network-vif-deleted:4d87f86a-c5c3-4dac-8e53-78bd55c3da76 for instance 13fbcf24-3a0e-4e17-bb4b-902364ee86db on hv-cinder-83625 Apr 12 00:28:52.273842 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-f04a8a90-db75-44e6-b057-29e131b80ebd req-ad59ea27-cdfd-4baf-a960-19a12d470189 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031184 Apr 12 00:28:52.274714 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 191/394] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:28:53.090106 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e7b5aa94-24a8-4228-ac7f-cbb22c14cf66 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:53.090933 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e7b5aa94-24a8-4228-ac7f-cbb22c14cf66 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:53.097845 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e7b5aa94-24a8-4228-ac7f-cbb22c14cf66 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:53.098530 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e7b5aa94-24a8-4228-ac7f-cbb22c14cf66 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:53.099468 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e7b5aa94-24a8-4228-ac7f-cbb22c14cf66 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:53.100285 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e7b5aa94-24a8-4228-ac7f-cbb22c14cf66 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:53.226616 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4d1bfbc9-c0fa-404f-9f2a-e4cf63bbfe89 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:53.227344 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-4d1bfbc9-c0fa-404f-9f2a-e4cf63bbfe89 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:53.242681 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4d1bfbc9-c0fa-404f-9f2a-e4cf63bbfe89 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:53.243120 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4d1bfbc9-c0fa-404f-9f2a-e4cf63bbfe89 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:53.243910 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4d1bfbc9-c0fa-404f-9f2a-e4cf63bbfe89 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:53.251346 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4d1bfbc9-c0fa-404f-9f2a-e4cf63bbfe89 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:53.302264 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e7b5aa94-24a8-4228-ac7f-cbb22c14cf66 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:53.304799 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4d1bfbc9-c0fa-404f-9f2a-e4cf63bbfe89 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:53.305795 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4d1bfbc9-c0fa-404f-9f2a-e4cf63bbfe89 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:53.307225 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-4d1bfbc9-c0fa-404f-9f2a-e4cf63bbfe89 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:28:53.313191 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e7b5aa94-24a8-4228-ac7f-cbb22c14cf66 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.226644 Apr 12 00:28:53.314408 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 204/395] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:53 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:53.398845 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-4d1bfbc9-c0fa-404f-9f2a-e4cf63bbfe89 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:53.406922 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-4d1bfbc9-c0fa-404f-9f2a-e4cf63bbfe89 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.196193 Apr 12 00:28:53.417231 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 192/396] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:53 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:28:54.331394 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b9ffd84f-bc29-40d8-9764-0116c15be95c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:54.332057 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b9ffd84f-bc29-40d8-9764-0116c15be95c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:54.339348 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9ffd84f-bc29-40d8-9764-0116c15be95c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:54.340074 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9ffd84f-bc29-40d8-9764-0116c15be95c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:54.340994 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9ffd84f-bc29-40d8-9764-0116c15be95c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:54.341578 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9ffd84f-bc29-40d8-9764-0116c15be95c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:54.425194 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f2afe08e-9651-4263-85d4-60e31693b982 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:54.425706 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f2afe08e-9651-4263-85d4-60e31693b982 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:54.435037 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2afe08e-9651-4263-85d4-60e31693b982 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:54.435533 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2afe08e-9651-4263-85d4-60e31693b982 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:54.440971 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2afe08e-9651-4263-85d4-60e31693b982 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:54.441444 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2afe08e-9651-4263-85d4-60e31693b982 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:54.483784 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2afe08e-9651-4263-85d4-60e31693b982 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:54.484538 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2afe08e-9651-4263-85d4-60e31693b982 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:54.485152 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-f2afe08e-9651-4263-85d4-60e31693b982 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:28:54.531364 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b9ffd84f-bc29-40d8-9764-0116c15be95c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:54.539890 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b9ffd84f-bc29-40d8-9764-0116c15be95c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.213356 Apr 12 00:28:54.540601 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 205/397] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:54 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:54.579033 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f2afe08e-9651-4263-85d4-60e31693b982 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:54.586194 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f2afe08e-9651-4263-85d4-60e31693b982 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.166055 Apr 12 00:28:54.587479 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 193/398] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:54 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:55.556770 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4012dfe0-4af2-4bbe-b722-91908995f834 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:55.557394 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4012dfe0-4af2-4bbe-b722-91908995f834 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:55.565320 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4012dfe0-4af2-4bbe-b722-91908995f834 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:55.565768 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4012dfe0-4af2-4bbe-b722-91908995f834 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:55.566984 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4012dfe0-4af2-4bbe-b722-91908995f834 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:55.567582 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4012dfe0-4af2-4bbe-b722-91908995f834 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:55.604268 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5a2ccfa2-fd3d-44fa-ad50-9db2f656640a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:55.604883 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5a2ccfa2-fd3d-44fa-ad50-9db2f656640a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:55.622359 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5a2ccfa2-fd3d-44fa-ad50-9db2f656640a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:55.622804 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5a2ccfa2-fd3d-44fa-ad50-9db2f656640a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:55.624305 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5a2ccfa2-fd3d-44fa-ad50-9db2f656640a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:55.624738 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5a2ccfa2-fd3d-44fa-ad50-9db2f656640a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:55.658933 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5a2ccfa2-fd3d-44fa-ad50-9db2f656640a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:55.661850 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5a2ccfa2-fd3d-44fa-ad50-9db2f656640a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:55.662487 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-5a2ccfa2-fd3d-44fa-ad50-9db2f656640a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:28:55.707669 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-5a2ccfa2-fd3d-44fa-ad50-9db2f656640a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:55.714587 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4012dfe0-4af2-4bbe-b722-91908995f834 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:55.715506 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5a2ccfa2-fd3d-44fa-ad50-9db2f656640a tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.115081 Apr 12 00:28:55.716195 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 194/399] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:55 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:55.722170 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4012dfe0-4af2-4bbe-b722-91908995f834 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.169151 Apr 12 00:28:55.731362 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 206/400] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:55 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:56.732865 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-fd54e349-78ab-4b89-b2a6-4012eee2a68c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:56.734667 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-fd54e349-78ab-4b89-b2a6-4012eee2a68c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:56.741406 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fd54e349-78ab-4b89-b2a6-4012eee2a68c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:56.741942 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f7edf582-0501-4ec5-a542-7b58a2b144a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:56.742676 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fd54e349-78ab-4b89-b2a6-4012eee2a68c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:56.742992 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f7edf582-0501-4ec5-a542-7b58a2b144a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:56.743794 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fd54e349-78ab-4b89-b2a6-4012eee2a68c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:56.744405 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fd54e349-78ab-4b89-b2a6-4012eee2a68c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:56.752108 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f7edf582-0501-4ec5-a542-7b58a2b144a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:56.753310 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f7edf582-0501-4ec5-a542-7b58a2b144a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:56.755006 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f7edf582-0501-4ec5-a542-7b58a2b144a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:56.755611 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f7edf582-0501-4ec5-a542-7b58a2b144a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:56.783762 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fd54e349-78ab-4b89-b2a6-4012eee2a68c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:56.784449 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fd54e349-78ab-4b89-b2a6-4012eee2a68c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:56.785078 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-fd54e349-78ab-4b89-b2a6-4012eee2a68c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:28:56.911579 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f7edf582-0501-4ec5-a542-7b58a2b144a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:56.919545 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f7edf582-0501-4ec5-a542-7b58a2b144a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.183087 Apr 12 00:28:56.921267 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 207/401] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:56 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:57.019259 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-fd54e349-78ab-4b89-b2a6-4012eee2a68c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:57.027248 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-fd54e349-78ab-4b89-b2a6-4012eee2a68c tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.298252 Apr 12 00:28:57.028073 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 195/402] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:56 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:57.940023 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-6df46148-070f-4bb8-8bf8-ed85648252a6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:57.943988 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-6df46148-070f-4bb8-8bf8-ed85648252a6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:57.952378 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6df46148-070f-4bb8-8bf8-ed85648252a6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:57.953178 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6df46148-070f-4bb8-8bf8-ed85648252a6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:57.954122 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6df46148-070f-4bb8-8bf8-ed85648252a6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:57.954884 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6df46148-070f-4bb8-8bf8-ed85648252a6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:58.044994 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-470d75e5-1154-4637-a74f-d42e8801d289 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:58.046126 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-470d75e5-1154-4637-a74f-d42e8801d289 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:58.056187 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-470d75e5-1154-4637-a74f-d42e8801d289 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:58.065093 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-470d75e5-1154-4637-a74f-d42e8801d289 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:58.066396 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-470d75e5-1154-4637-a74f-d42e8801d289 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:58.067721 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-470d75e5-1154-4637-a74f-d42e8801d289 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:58.161755 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-470d75e5-1154-4637-a74f-d42e8801d289 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:58.162606 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-470d75e5-1154-4637-a74f-d42e8801d289 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:58.162722 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-470d75e5-1154-4637-a74f-d42e8801d289 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:28:58.195728 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-6df46148-070f-4bb8-8bf8-ed85648252a6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:58.210146 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-6df46148-070f-4bb8-8bf8-ed85648252a6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.276119 Apr 12 00:28:58.211524 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 208/403] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:57 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:58.246053 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-470d75e5-1154-4637-a74f-d42e8801d289 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:58.254479 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-470d75e5-1154-4637-a74f-d42e8801d289 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.213295 Apr 12 00:28:58.256141 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 196/404] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:58 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:59.230207 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-147af23a-d4e3-4bf4-9fb7-4ec0d657fc37 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:59.231081 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-147af23a-d4e3-4bf4-9fb7-4ec0d657fc37 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:59.258206 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-147af23a-d4e3-4bf4-9fb7-4ec0d657fc37 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:59.264034 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-147af23a-d4e3-4bf4-9fb7-4ec0d657fc37 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:59.266798 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-147af23a-d4e3-4bf4-9fb7-4ec0d657fc37 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:59.268664 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-147af23a-d4e3-4bf4-9fb7-4ec0d657fc37 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:59.273453 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-ca1e0599-f997-42bb-a8fe-ee4cb425c992 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:28:59.274072 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-ca1e0599-f997-42bb-a8fe-ee4cb425c992 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:28:59.284591 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ca1e0599-f997-42bb-a8fe-ee4cb425c992 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:59.285640 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ca1e0599-f997-42bb-a8fe-ee4cb425c992 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:59.286837 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ca1e0599-f997-42bb-a8fe-ee4cb425c992 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:59.287586 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ca1e0599-f997-42bb-a8fe-ee4cb425c992 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:59.324511 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ca1e0599-f997-42bb-a8fe-ee4cb425c992 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:28:59.325130 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ca1e0599-f997-42bb-a8fe-ee4cb425c992 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:28:59.325698 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-ca1e0599-f997-42bb-a8fe-ee4cb425c992 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:28:59.402425 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ca1e0599-f997-42bb-a8fe-ee4cb425c992 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:59.415698 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-ca1e0599-f997-42bb-a8fe-ee4cb425c992 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.146873 Apr 12 00:28:59.416983 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 197/405] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:59 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:28:59.512886 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-147af23a-d4e3-4bf4-9fb7-4ec0d657fc37 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:28:59.521527 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-147af23a-d4e3-4bf4-9fb7-4ec0d657fc37 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.297199 Apr 12 00:28:59.533151 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 209/406] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:28:59 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:00.435860 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-db5bfead-c3d7-4ca3-bb9b-e5f8caa0e6da tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:00.439599 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-db5bfead-c3d7-4ca3-bb9b-e5f8caa0e6da tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:00.446632 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-db5bfead-c3d7-4ca3-bb9b-e5f8caa0e6da tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:00.447379 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-db5bfead-c3d7-4ca3-bb9b-e5f8caa0e6da tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:00.454836 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-db5bfead-c3d7-4ca3-bb9b-e5f8caa0e6da tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:00.455289 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-db5bfead-c3d7-4ca3-bb9b-e5f8caa0e6da tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:00.501517 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-db5bfead-c3d7-4ca3-bb9b-e5f8caa0e6da tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:00.501963 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-db5bfead-c3d7-4ca3-bb9b-e5f8caa0e6da tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:00.502605 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-db5bfead-c3d7-4ca3-bb9b-e5f8caa0e6da tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:29:00.540117 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8136734a-c503-4e06-9d79-09f04a0d9acd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:00.540729 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8136734a-c503-4e06-9d79-09f04a0d9acd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:00.547920 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8136734a-c503-4e06-9d79-09f04a0d9acd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:00.548710 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8136734a-c503-4e06-9d79-09f04a0d9acd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:00.549730 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8136734a-c503-4e06-9d79-09f04a0d9acd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:00.550590 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8136734a-c503-4e06-9d79-09f04a0d9acd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:00.602977 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-db5bfead-c3d7-4ca3-bb9b-e5f8caa0e6da tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:00.611670 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-db5bfead-c3d7-4ca3-bb9b-e5f8caa0e6da tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.182134 Apr 12 00:29:00.612833 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 198/407] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:00 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:00.715921 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8136734a-c503-4e06-9d79-09f04a0d9acd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:00.724276 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8136734a-c503-4e06-9d79-09f04a0d9acd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.187903 Apr 12 00:29:00.734236 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 210/408] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:00 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:29:01.001204 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-365193b5-4217-4c56-85bc-4663e3e2f0db tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Action: 'create', calling method: .version_select at 0x7f64e1350790>, body: {"keypair": {"name": "tempest-TestShelveInstance-147522559"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:01.019368 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-365193b5-4217-4c56-85bc-4663e3e2f0db tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Getting quotas for project c03f71e524b24b8abf5e7c81842f4e75. Resources: {'key_pairs'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:29:01.023393 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-365193b5-4217-4c56-85bc-4663e3e2f0db tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Getting quotas for user 8ee7971dfb4e4c22aac3d97db9ee04d0 and project c03f71e524b24b8abf5e7c81842f4e75. Resources: {'key_pairs'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:29:01.239403 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-365193b5-4217-4c56-85bc-4663e3e2f0db tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Getting quotas for project c03f71e524b24b8abf5e7c81842f4e75. Resources: {'key_pairs'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:29:01.243139 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-365193b5-4217-4c56-85bc-4663e3e2f0db tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Getting quotas for user 8ee7971dfb4e4c22aac3d97db9ee04d0 and project c03f71e524b24b8abf5e7c81842f4e75. Resources: {'key_pairs'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:29:01.255851 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-365193b5-4217-4c56-85bc-4663e3e2f0db tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.443685 Apr 12 00:29:01.256456 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 199/409] 10.222.0.32 () {60 vars in 1157 bytes} [Tue Apr 12 00:29:00 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:01.629550 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-031107e8-4fc9-4c42-b75b-10e191d84687 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:01.630162 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-031107e8-4fc9-4c42-b75b-10e191d84687 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:01.636323 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-031107e8-4fc9-4c42-b75b-10e191d84687 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:01.636777 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-031107e8-4fc9-4c42-b75b-10e191d84687 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:01.637544 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-031107e8-4fc9-4c42-b75b-10e191d84687 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:01.637983 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-031107e8-4fc9-4c42-b75b-10e191d84687 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:01.683664 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-031107e8-4fc9-4c42-b75b-10e191d84687 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:01.684115 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-031107e8-4fc9-4c42-b75b-10e191d84687 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:01.684564 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-031107e8-4fc9-4c42-b75b-10e191d84687 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:29:01.737768 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-031107e8-4fc9-4c42-b75b-10e191d84687 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:01.741375 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-ae867ca2-ecb6-4a18-8024-b90730ff6429 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:01.742241 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-ae867ca2-ecb6-4a18-8024-b90730ff6429 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:01.745043 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-031107e8-4fc9-4c42-b75b-10e191d84687 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.119735 Apr 12 00:29:01.745673 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 211/410] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:01 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:01.748748 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ae867ca2-ecb6-4a18-8024-b90730ff6429 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:01.749192 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ae867ca2-ecb6-4a18-8024-b90730ff6429 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:01.749951 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ae867ca2-ecb6-4a18-8024-b90730ff6429 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:01.750581 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ae867ca2-ecb6-4a18-8024-b90730ff6429 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:01.893033 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ae867ca2-ecb6-4a18-8024-b90730ff6429 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:01.901355 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-ae867ca2-ecb6-4a18-8024-b90730ff6429 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.164027 Apr 12 00:29:01.901995 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 200/411] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:01 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:29:02.762550 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b9e9d8ca-fe19-479d-b070-2eed5686ad84 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:02.763189 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b9e9d8ca-fe19-479d-b070-2eed5686ad84 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:02.769668 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9e9d8ca-fe19-479d-b070-2eed5686ad84 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:02.770187 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9e9d8ca-fe19-479d-b070-2eed5686ad84 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:02.771053 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9e9d8ca-fe19-479d-b070-2eed5686ad84 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:02.771665 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9e9d8ca-fe19-479d-b070-2eed5686ad84 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:02.801917 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9e9d8ca-fe19-479d-b070-2eed5686ad84 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:02.802399 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9e9d8ca-fe19-479d-b070-2eed5686ad84 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:02.803056 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-b9e9d8ca-fe19-479d-b070-2eed5686ad84 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:29:02.844623 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b9e9d8ca-fe19-479d-b070-2eed5686ad84 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:02.852315 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b9e9d8ca-fe19-479d-b070-2eed5686ad84 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.093640 Apr 12 00:29:02.853128 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 212/412] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:02 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:02.920711 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1e859e02-4349-4e88-beb3-92908950391a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:02.922100 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1e859e02-4349-4e88-beb3-92908950391a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:02.933823 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1e859e02-4349-4e88-beb3-92908950391a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:02.941180 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1e859e02-4349-4e88-beb3-92908950391a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:02.941180 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1e859e02-4349-4e88-beb3-92908950391a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:02.941180 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1e859e02-4349-4e88-beb3-92908950391a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:03.105585 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1e859e02-4349-4e88-beb3-92908950391a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:03.122615 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1e859e02-4349-4e88-beb3-92908950391a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.206876 Apr 12 00:29:03.123103 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 201/413] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:02 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:03.870222 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1e30c20d-8840-4c00-bd25-634f1c67a14f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:03.870940 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1e30c20d-8840-4c00-bd25-634f1c67a14f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:03.879465 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1e30c20d-8840-4c00-bd25-634f1c67a14f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:03.879927 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1e30c20d-8840-4c00-bd25-634f1c67a14f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:03.880708 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1e30c20d-8840-4c00-bd25-634f1c67a14f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:03.881405 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1e30c20d-8840-4c00-bd25-634f1c67a14f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:03.914341 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1e30c20d-8840-4c00-bd25-634f1c67a14f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:03.914798 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1e30c20d-8840-4c00-bd25-634f1c67a14f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:03.915246 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-1e30c20d-8840-4c00-bd25-634f1c67a14f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:29:03.985729 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1e30c20d-8840-4c00-bd25-634f1c67a14f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:04.000591 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1e30c20d-8840-4c00-bd25-634f1c67a14f tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.134884 Apr 12 00:29:04.001189 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 213/414] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:03 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:04.140312 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-084200be-4f5d-4a5d-9f58-40866f3068c8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:04.141014 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-084200be-4f5d-4a5d-9f58-40866f3068c8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:04.147724 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-084200be-4f5d-4a5d-9f58-40866f3068c8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:04.148463 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-084200be-4f5d-4a5d-9f58-40866f3068c8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:04.149294 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-084200be-4f5d-4a5d-9f58-40866f3068c8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:04.149798 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-084200be-4f5d-4a5d-9f58-40866f3068c8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:04.291501 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-084200be-4f5d-4a5d-9f58-40866f3068c8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:04.299461 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-084200be-4f5d-4a5d-9f58-40866f3068c8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.163404 Apr 12 00:29:04.300034 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 202/415] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:04 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:05.017486 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c5ad5cfd-0ef5-4c1b-a409-2bd9e6a48849 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:05.018016 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c5ad5cfd-0ef5-4c1b-a409-2bd9e6a48849 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:05.024435 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c5ad5cfd-0ef5-4c1b-a409-2bd9e6a48849 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:05.024889 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c5ad5cfd-0ef5-4c1b-a409-2bd9e6a48849 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:05.025640 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c5ad5cfd-0ef5-4c1b-a409-2bd9e6a48849 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:05.026071 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c5ad5cfd-0ef5-4c1b-a409-2bd9e6a48849 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:05.057441 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c5ad5cfd-0ef5-4c1b-a409-2bd9e6a48849 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:05.057883 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c5ad5cfd-0ef5-4c1b-a409-2bd9e6a48849 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:05.058347 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-c5ad5cfd-0ef5-4c1b-a409-2bd9e6a48849 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:29:05.097427 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-c5ad5cfd-0ef5-4c1b-a409-2bd9e6a48849 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:05.105594 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c5ad5cfd-0ef5-4c1b-a409-2bd9e6a48849 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.092535 Apr 12 00:29:05.106152 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 214/416] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:05 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:05.316644 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d6112303-84e3-4512-ba00-622f2b6aaf8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:05.317248 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d6112303-84e3-4512-ba00-622f2b6aaf8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:05.323547 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d6112303-84e3-4512-ba00-622f2b6aaf8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:05.323995 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d6112303-84e3-4512-ba00-622f2b6aaf8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:05.324748 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d6112303-84e3-4512-ba00-622f2b6aaf8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:05.325354 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d6112303-84e3-4512-ba00-622f2b6aaf8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:05.454167 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d6112303-84e3-4512-ba00-622f2b6aaf8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:05.461643 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d6112303-84e3-4512-ba00-622f2b6aaf8b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.148775 Apr 12 00:29:05.462196 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 203/417] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:05 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:06.121494 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-58cdef4e-65cf-4447-9f5e-4d84db0451ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:06.122101 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-58cdef4e-65cf-4447-9f5e-4d84db0451ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:06.129026 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-58cdef4e-65cf-4447-9f5e-4d84db0451ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:06.129486 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-58cdef4e-65cf-4447-9f5e-4d84db0451ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:06.130238 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-58cdef4e-65cf-4447-9f5e-4d84db0451ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:06.130696 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-58cdef4e-65cf-4447-9f5e-4d84db0451ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:06.159877 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-58cdef4e-65cf-4447-9f5e-4d84db0451ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:06.160323 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-58cdef4e-65cf-4447-9f5e-4d84db0451ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:06.160766 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-58cdef4e-65cf-4447-9f5e-4d84db0451ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:29:06.200137 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-58cdef4e-65cf-4447-9f5e-4d84db0451ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:06.208637 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-58cdef4e-65cf-4447-9f5e-4d84db0451ac tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.090883 Apr 12 00:29:06.213162 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 215/418] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:06 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:06.479098 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d715da23-aa1d-4d00-9757-8a2d4155ca38 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:06.479776 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d715da23-aa1d-4d00-9757-8a2d4155ca38 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:06.486221 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d715da23-aa1d-4d00-9757-8a2d4155ca38 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:06.486711 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d715da23-aa1d-4d00-9757-8a2d4155ca38 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:06.487500 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d715da23-aa1d-4d00-9757-8a2d4155ca38 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:06.487952 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d715da23-aa1d-4d00-9757-8a2d4155ca38 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:06.624287 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d715da23-aa1d-4d00-9757-8a2d4155ca38 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:06.631411 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d715da23-aa1d-4d00-9757-8a2d4155ca38 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.156404 Apr 12 00:29:06.631974 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 204/419] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:06 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:07.226305 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-406cbaca-bcd0-45b3-a49e-d61dee1b8b37 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:07.226907 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-406cbaca-bcd0-45b3-a49e-d61dee1b8b37 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:07.233607 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-406cbaca-bcd0-45b3-a49e-d61dee1b8b37 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:07.234051 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-406cbaca-bcd0-45b3-a49e-d61dee1b8b37 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:07.234826 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-406cbaca-bcd0-45b3-a49e-d61dee1b8b37 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:07.235256 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-406cbaca-bcd0-45b3-a49e-d61dee1b8b37 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:07.264139 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-406cbaca-bcd0-45b3-a49e-d61dee1b8b37 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:07.264586 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-406cbaca-bcd0-45b3-a49e-d61dee1b8b37 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:07.265018 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-406cbaca-bcd0-45b3-a49e-d61dee1b8b37 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:29:07.304724 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-406cbaca-bcd0-45b3-a49e-d61dee1b8b37 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:07.312506 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-406cbaca-bcd0-45b3-a49e-d61dee1b8b37 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.090077 Apr 12 00:29:07.313046 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 216/420] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:07 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:07.649252 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-0c0db8c5-f54f-42a8-bc3e-d32b7512478e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:07.649803 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-0c0db8c5-f54f-42a8-bc3e-d32b7512478e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:07.656290 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0c0db8c5-f54f-42a8-bc3e-d32b7512478e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:07.656737 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0c0db8c5-f54f-42a8-bc3e-d32b7512478e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:07.657490 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0c0db8c5-f54f-42a8-bc3e-d32b7512478e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:07.657918 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0c0db8c5-f54f-42a8-bc3e-d32b7512478e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:07.789229 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-0c0db8c5-f54f-42a8-bc3e-d32b7512478e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:07.796419 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-0c0db8c5-f54f-42a8-bc3e-d32b7512478e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.151515 Apr 12 00:29:07.796988 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 205/421] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:07 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:08.329422 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e61d377e-095e-496b-80ef-e365655ab543 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:08.330059 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e61d377e-095e-496b-80ef-e365655ab543 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:08.336293 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e61d377e-095e-496b-80ef-e365655ab543 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:08.336743 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e61d377e-095e-496b-80ef-e365655ab543 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:08.337532 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e61d377e-095e-496b-80ef-e365655ab543 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:08.337972 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e61d377e-095e-496b-80ef-e365655ab543 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:08.366379 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e61d377e-095e-496b-80ef-e365655ab543 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:08.366827 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e61d377e-095e-496b-80ef-e365655ab543 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:08.367263 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-e61d377e-095e-496b-80ef-e365655ab543 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:29:08.408640 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e61d377e-095e-496b-80ef-e365655ab543 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:08.416043 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e61d377e-095e-496b-80ef-e365655ab543 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.090998 Apr 12 00:29:08.416568 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 217/422] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:08 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:08.813373 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-8930b4bf-3805-4e9c-a851-15ae931c42a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:08.813975 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-8930b4bf-3805-4e9c-a851-15ae931c42a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:08.820171 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8930b4bf-3805-4e9c-a851-15ae931c42a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:08.820616 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8930b4bf-3805-4e9c-a851-15ae931c42a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:08.821566 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8930b4bf-3805-4e9c-a851-15ae931c42a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:08.821992 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8930b4bf-3805-4e9c-a851-15ae931c42a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:08.948621 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-8930b4bf-3805-4e9c-a851-15ae931c42a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:08.955762 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-8930b4bf-3805-4e9c-a851-15ae931c42a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.146796 Apr 12 00:29:08.956331 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 206/423] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:08 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:09.432720 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b9570739-39a8-4083-9024-76ed85ec1503 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:09.433325 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b9570739-39a8-4083-9024-76ed85ec1503 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:09.439683 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9570739-39a8-4083-9024-76ed85ec1503 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:09.440129 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9570739-39a8-4083-9024-76ed85ec1503 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:09.440884 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9570739-39a8-4083-9024-76ed85ec1503 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:09.441320 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9570739-39a8-4083-9024-76ed85ec1503 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:09.470710 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9570739-39a8-4083-9024-76ed85ec1503 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:09.471131 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9570739-39a8-4083-9024-76ed85ec1503 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:09.471573 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-b9570739-39a8-4083-9024-76ed85ec1503 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:29:09.509936 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b9570739-39a8-4083-9024-76ed85ec1503 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:09.517631 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b9570739-39a8-4083-9024-76ed85ec1503 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.088736 Apr 12 00:29:09.518197 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 218/424] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:09 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:09.972215 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e7b906f2-019c-45af-b253-72e1f49e5bd3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:09.972826 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e7b906f2-019c-45af-b253-72e1f49e5bd3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:09.978993 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e7b906f2-019c-45af-b253-72e1f49e5bd3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:09.979436 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e7b906f2-019c-45af-b253-72e1f49e5bd3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:09.980181 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e7b906f2-019c-45af-b253-72e1f49e5bd3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:09.980607 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e7b906f2-019c-45af-b253-72e1f49e5bd3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:10.110230 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e7b906f2-019c-45af-b253-72e1f49e5bd3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:10.117399 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e7b906f2-019c-45af-b253-72e1f49e5bd3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.148929 Apr 12 00:29:10.117969 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 207/425] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:09 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:10.534884 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1ce391bb-7aa0-46c5-ac06-79894a9929c4 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:10.535496 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1ce391bb-7aa0-46c5-ac06-79894a9929c4 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:10.541694 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1ce391bb-7aa0-46c5-ac06-79894a9929c4 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:10.542139 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1ce391bb-7aa0-46c5-ac06-79894a9929c4 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:10.542926 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1ce391bb-7aa0-46c5-ac06-79894a9929c4 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:10.543361 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1ce391bb-7aa0-46c5-ac06-79894a9929c4 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:10.573884 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1ce391bb-7aa0-46c5-ac06-79894a9929c4 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:10.574365 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1ce391bb-7aa0-46c5-ac06-79894a9929c4 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:10.574807 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-1ce391bb-7aa0-46c5-ac06-79894a9929c4 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lazy-loading 'fault' on Instance uuid 13fbcf24-3a0e-4e17-bb4b-902364ee86db {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:29:10.619617 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1ce391bb-7aa0-46c5-ac06-79894a9929c4 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1db4aee3a4d43ccb111eb7ede0510d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b239e9580469aaa5714c21a4c590d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:10.627025 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1ce391bb-7aa0-46c5-ac06-79894a9929c4 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 200 len: 1304 microversion: 2.1 time: 0.095994 Apr 12 00:29:10.627584 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 219/426] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:10 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:11.134948 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-dce0ab54-2475-4b27-8e61-df3977e569ee tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:11.135572 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-dce0ab54-2475-4b27-8e61-df3977e569ee tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:11.141677 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dce0ab54-2475-4b27-8e61-df3977e569ee tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:11.142103 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dce0ab54-2475-4b27-8e61-df3977e569ee tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:11.142879 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dce0ab54-2475-4b27-8e61-df3977e569ee tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:11.143306 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dce0ab54-2475-4b27-8e61-df3977e569ee tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:11.268834 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-dce0ab54-2475-4b27-8e61-df3977e569ee tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:11.276160 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-dce0ab54-2475-4b27-8e61-df3977e569ee tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.145179 Apr 12 00:29:11.276719 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 208/427] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:11 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:11.644744 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8342d7be-d868-4bdb-86ad-3df0e593c375 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:11.645285 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8342d7be-d868-4bdb-86ad-3df0e593c375 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] [instance: 13fbcf24-3a0e-4e17-bb4b-902364ee86db] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:11.652028 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8342d7be-d868-4bdb-86ad-3df0e593c375 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:11.652481 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8342d7be-d868-4bdb-86ad-3df0e593c375 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:11.653307 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8342d7be-d868-4bdb-86ad-3df0e593c375 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:11.653747 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8342d7be-d868-4bdb-86ad-3df0e593c375 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:11.667478 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-8342d7be-d868-4bdb-86ad-3df0e593c375 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] HTTP exception thrown: Instance 13fbcf24-3a0e-4e17-bb4b-902364ee86db could not be found. Apr 12 00:29:11.668082 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8342d7be-d868-4bdb-86ad-3df0e593c375 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] Returning 404 to user: Instance 13fbcf24-3a0e-4e17-bb4b-902364ee86db could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:29:11.669091 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8342d7be-d868-4bdb-86ad-3df0e593c375 tempest-VolumesActionsTest-1177353602 tempest-VolumesActionsTest-1177353602-project] 10.222.0.32 "GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db" status: 404 len: 111 microversion: 2.1 time: 0.028331 Apr 12 00:29:11.669636 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 220/428] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:11 2022] GET /compute/v2.1/servers/13fbcf24-3a0e-4e17-bb4b-902364ee86db => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:29:12.292741 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b7eb3987-0cf6-42a0-933a-4c59cfa32318 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:12.293347 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b7eb3987-0cf6-42a0-933a-4c59cfa32318 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:12.299825 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b7eb3987-0cf6-42a0-933a-4c59cfa32318 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:12.300269 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b7eb3987-0cf6-42a0-933a-4c59cfa32318 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:12.301029 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b7eb3987-0cf6-42a0-933a-4c59cfa32318 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:12.301469 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b7eb3987-0cf6-42a0-933a-4c59cfa32318 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:12.440403 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b7eb3987-0cf6-42a0-933a-4c59cfa32318 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:12.447531 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b7eb3987-0cf6-42a0-933a-4c59cfa32318 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.158572 Apr 12 00:29:12.448099 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 209/429] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:12 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:12.759028 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-3e254c7b-ed22-4d97-9b3c-ac45e852ef12 req-c5052055-b169-4df2-aafc-ab6a2c8b97f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a3e7dc-86c5-42ab-8a46-126c80dd1adc", "name": "network-vif-plugged", "status": "completed", "tag": "acbbc313-dcc4-4731-a931-77e1a5d10277"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:12.767870 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-3e254c7b-ed22-4d97-9b3c-ac45e852ef12 req-c5052055-b169-4df2-aafc-ab6a2c8b97f0 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:12.768375 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-3e254c7b-ed22-4d97-9b3c-ac45e852ef12 req-c5052055-b169-4df2-aafc-ab6a2c8b97f0 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:12.781469 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-3e254c7b-ed22-4d97-9b3c-ac45e852ef12 req-c5052055-b169-4df2-aafc-ab6a2c8b97f0 service nova] Creating event network-vif-plugged:acbbc313-dcc4-4731-a931-77e1a5d10277 for instance 85a3e7dc-86c5-42ab-8a46-126c80dd1adc on hv-cinder-83625 Apr 12 00:29:12.786348 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-3e254c7b-ed22-4d97-9b3c-ac45e852ef12 req-c5052055-b169-4df2-aafc-ab6a2c8b97f0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030943 Apr 12 00:29:12.786924 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 221/430] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:29:13.466435 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-750c7200-338c-49e0-9a0d-7f2db303ad88 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:13.467558 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-750c7200-338c-49e0-9a0d-7f2db303ad88 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:13.473713 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-750c7200-338c-49e0-9a0d-7f2db303ad88 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:13.474183 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-750c7200-338c-49e0-9a0d-7f2db303ad88 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:13.474981 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-750c7200-338c-49e0-9a0d-7f2db303ad88 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:13.475415 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-750c7200-338c-49e0-9a0d-7f2db303ad88 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:13.603162 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-750c7200-338c-49e0-9a0d-7f2db303ad88 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:13.610866 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-750c7200-338c-49e0-9a0d-7f2db303ad88 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.148223 Apr 12 00:29:13.611657 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 210/431] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:13 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:14.628711 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8df6db0b-dd76-4ccf-8404-fd24cfa659b6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:14.629433 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8df6db0b-dd76-4ccf-8404-fd24cfa659b6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:14.635396 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8df6db0b-dd76-4ccf-8404-fd24cfa659b6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:14.635856 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8df6db0b-dd76-4ccf-8404-fd24cfa659b6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:14.636619 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8df6db0b-dd76-4ccf-8404-fd24cfa659b6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:14.637053 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8df6db0b-dd76-4ccf-8404-fd24cfa659b6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:14.761313 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8df6db0b-dd76-4ccf-8404-fd24cfa659b6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:14.768461 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8df6db0b-dd76-4ccf-8404-fd24cfa659b6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.144418 Apr 12 00:29:14.769025 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 222/432] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:14 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:15.785408 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c20f6c2d-2cd0-4b0b-a53c-7218513cd555 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:15.785944 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c20f6c2d-2cd0-4b0b-a53c-7218513cd555 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:15.792166 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c20f6c2d-2cd0-4b0b-a53c-7218513cd555 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:15.792605 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c20f6c2d-2cd0-4b0b-a53c-7218513cd555 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:15.793347 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c20f6c2d-2cd0-4b0b-a53c-7218513cd555 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:15.793774 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c20f6c2d-2cd0-4b0b-a53c-7218513cd555 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:15.923180 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c20f6c2d-2cd0-4b0b-a53c-7218513cd555 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:15.930344 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c20f6c2d-2cd0-4b0b-a53c-7218513cd555 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.148838 Apr 12 00:29:15.930901 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 211/433] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:15 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:16.947112 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-34827f7d-0087-4425-8d56-e441fc39145c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:16.947714 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-34827f7d-0087-4425-8d56-e441fc39145c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:16.954426 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-34827f7d-0087-4425-8d56-e441fc39145c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:16.954873 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-34827f7d-0087-4425-8d56-e441fc39145c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:16.955623 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-34827f7d-0087-4425-8d56-e441fc39145c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:16.956057 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-34827f7d-0087-4425-8d56-e441fc39145c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:17.080044 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-34827f7d-0087-4425-8d56-e441fc39145c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:17.087214 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-34827f7d-0087-4425-8d56-e441fc39145c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.143912 Apr 12 00:29:17.087772 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 223/434] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:16 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:18.104315 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-680741dd-377f-4a13-9f50-8d8896ed83e7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:18.104920 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-680741dd-377f-4a13-9f50-8d8896ed83e7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:18.111807 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-680741dd-377f-4a13-9f50-8d8896ed83e7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:18.112247 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-680741dd-377f-4a13-9f50-8d8896ed83e7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:18.112998 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-680741dd-377f-4a13-9f50-8d8896ed83e7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:18.113426 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-680741dd-377f-4a13-9f50-8d8896ed83e7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:18.244353 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-680741dd-377f-4a13-9f50-8d8896ed83e7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:18.251904 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-680741dd-377f-4a13-9f50-8d8896ed83e7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.151422 Apr 12 00:29:18.252770 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 212/435] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:18 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:19.269735 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-69e335b5-9c8a-4b75-a595-ddbf0cde6eec tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:19.270464 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-69e335b5-9c8a-4b75-a595-ddbf0cde6eec tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:19.277399 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-69e335b5-9c8a-4b75-a595-ddbf0cde6eec tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:19.277865 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-69e335b5-9c8a-4b75-a595-ddbf0cde6eec tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:19.278640 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-69e335b5-9c8a-4b75-a595-ddbf0cde6eec tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:19.279693 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-69e335b5-9c8a-4b75-a595-ddbf0cde6eec tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:19.407222 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-69e335b5-9c8a-4b75-a595-ddbf0cde6eec tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:19.414410 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-69e335b5-9c8a-4b75-a595-ddbf0cde6eec tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.148948 Apr 12 00:29:19.414974 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 224/436] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:19 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:20.431429 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f2c552ec-710e-4d22-873e-c1bd40d61813 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:20.432036 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f2c552ec-710e-4d22-873e-c1bd40d61813 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:20.438375 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2c552ec-710e-4d22-873e-c1bd40d61813 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:20.438817 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2c552ec-710e-4d22-873e-c1bd40d61813 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:20.439563 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2c552ec-710e-4d22-873e-c1bd40d61813 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:20.439988 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2c552ec-710e-4d22-873e-c1bd40d61813 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:20.570284 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f2c552ec-710e-4d22-873e-c1bd40d61813 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:20.582540 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f2c552ec-710e-4d22-873e-c1bd40d61813 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1370 microversion: 2.1 time: 0.154537 Apr 12 00:29:20.583419 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 213/437] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:20 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:21.605537 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8a97bd3b-1862-4ca4-a1a4-8a07e808d3bc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:21.607594 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8a97bd3b-1862-4ca4-a1a4-8a07e808d3bc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:21.616552 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8a97bd3b-1862-4ca4-a1a4-8a07e808d3bc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:21.617087 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8a97bd3b-1862-4ca4-a1a4-8a07e808d3bc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:21.618141 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8a97bd3b-1862-4ca4-a1a4-8a07e808d3bc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:21.618792 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8a97bd3b-1862-4ca4-a1a4-8a07e808d3bc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:21.781883 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8a97bd3b-1862-4ca4-a1a4-8a07e808d3bc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:21.790206 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8a97bd3b-1862-4ca4-a1a4-8a07e808d3bc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1564 microversion: 2.1 time: 0.191251 Apr 12 00:29:21.790901 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 225/438] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:21 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1564 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:21.807190 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c4bc2982-7bd2-4fb2-b9f2-d7b1841b687c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:21.808505 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c4bc2982-7bd2-4fb2-b9f2-d7b1841b687c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:21.815680 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4bc2982-7bd2-4fb2-b9f2-d7b1841b687c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:21.816124 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4bc2982-7bd2-4fb2-b9f2-d7b1841b687c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:21.816906 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4bc2982-7bd2-4fb2-b9f2-d7b1841b687c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:21.817314 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4bc2982-7bd2-4fb2-b9f2-d7b1841b687c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:21.908072 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ebd9738b-9919-49f7-b3cc-220ede3591a0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:21.908568 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ebd9738b-9919-49f7-b3cc-220ede3591a0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:21.915054 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ebd9738b-9919-49f7-b3cc-220ede3591a0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:21.915503 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ebd9738b-9919-49f7-b3cc-220ede3591a0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:21.916292 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ebd9738b-9919-49f7-b3cc-220ede3591a0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:21.916716 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ebd9738b-9919-49f7-b3cc-220ede3591a0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:21.936477 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c4bc2982-7bd2-4fb2-b9f2-d7b1841b687c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133138 Apr 12 00:29:21.937272 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 214/439] 10.222.0.32 () {58 vars in 1274 bytes} [Tue Apr 12 00:29:21 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:29:22.109748 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-ebd9738b-9919-49f7-b3cc-220ede3591a0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lazy-loading 'services' on Instance uuid 6443b855-1525-4e40-bfa0-a16e1c2de983 {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:29:22.262772 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ebd9738b-9919-49f7-b3cc-220ede3591a0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983/os-volume_attachments/345595e2-ce3c-427a-84b0-c9cdd8adfe13" status: 202 len: 0 microversion: 2.1 time: 0.358897 Apr 12 00:29:22.264849 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 226/440] 10.222.0.32 () {58 vars in 1415 bytes} [Tue Apr 12 00:29:21 2022] DELETE /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983/os-volume_attachments/345595e2-ce3c-427a-84b0-c9cdd8adfe13 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 00:29:23.201701 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-54fd0bc2-88ca-4372-b0a0-38685c05e929 req-d5e347ce-1839-43ba-9901-17df61ba0986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a3e7dc-86c5-42ab-8a46-126c80dd1adc", "tag": "acbbc313-dcc4-4731-a931-77e1a5d10277"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:23.212115 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-54fd0bc2-88ca-4372-b0a0-38685c05e929 req-d5e347ce-1839-43ba-9901-17df61ba0986 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:23.212529 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-54fd0bc2-88ca-4372-b0a0-38685c05e929 req-d5e347ce-1839-43ba-9901-17df61ba0986 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:23.225310 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-54fd0bc2-88ca-4372-b0a0-38685c05e929 req-d5e347ce-1839-43ba-9901-17df61ba0986 service nova] Creating event network-changed:acbbc313-dcc4-4731-a931-77e1a5d10277 for instance 85a3e7dc-86c5-42ab-8a46-126c80dd1adc on hv-cinder-83625 Apr 12 00:29:23.230949 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-54fd0bc2-88ca-4372-b0a0-38685c05e929 req-d5e347ce-1839-43ba-9901-17df61ba0986 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033794 Apr 12 00:29:23.231931 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 215/441] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:29:24.496135 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-19111c5f-bc38-4d9b-9a64-29f19d34f308 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:24.497344 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-19111c5f-bc38-4d9b-9a64-29f19d34f308 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:24.506047 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-19111c5f-bc38-4d9b-9a64-29f19d34f308 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:24.506716 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-19111c5f-bc38-4d9b-9a64-29f19d34f308 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:24.507737 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-19111c5f-bc38-4d9b-9a64-29f19d34f308 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:24.508245 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-19111c5f-bc38-4d9b-9a64-29f19d34f308 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:24.539997 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-19111c5f-bc38-4d9b-9a64-29f19d34f308 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Going to try to terminate instance {{(pid=128486) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:29:24.637012 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-19111c5f-bc38-4d9b-9a64-29f19d34f308 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 204 len: 0 microversion: 2.1 time: 0.144855 Apr 12 00:29:24.638134 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 227/442] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:29:24 2022] DELETE /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:29:24.649141 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-046bbcf0-6c1c-4bf3-a09d-4614aa14b3c9 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:24.649865 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-046bbcf0-6c1c-4bf3-a09d-4614aa14b3c9 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:24.657123 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-046bbcf0-6c1c-4bf3-a09d-4614aa14b3c9 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:24.657571 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-046bbcf0-6c1c-4bf3-a09d-4614aa14b3c9 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:24.658362 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-046bbcf0-6c1c-4bf3-a09d-4614aa14b3c9 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:24.658787 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-046bbcf0-6c1c-4bf3-a09d-4614aa14b3c9 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:24.826492 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-046bbcf0-6c1c-4bf3-a09d-4614aa14b3c9 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:24.837531 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-046bbcf0-6c1c-4bf3-a09d-4614aa14b3c9 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1513 microversion: 2.1 time: 0.193157 Apr 12 00:29:24.848677 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 216/443] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:24 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:25.856682 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a8da1f8a-d4c7-44fb-9049-98129a493fc4 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:25.858025 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a8da1f8a-d4c7-44fb-9049-98129a493fc4 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:25.864869 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8da1f8a-d4c7-44fb-9049-98129a493fc4 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:25.865324 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8da1f8a-d4c7-44fb-9049-98129a493fc4 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:25.866105 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8da1f8a-d4c7-44fb-9049-98129a493fc4 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:25.866571 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8da1f8a-d4c7-44fb-9049-98129a493fc4 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:26.007815 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a8da1f8a-d4c7-44fb-9049-98129a493fc4 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:26.016488 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a8da1f8a-d4c7-44fb-9049-98129a493fc4 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1513 microversion: 2.1 time: 0.164077 Apr 12 00:29:26.026469 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 228/444] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:25 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:27.034838 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9ad3d3c6-7712-4e21-bcbf-fadb8958cab3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:27.035408 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-9ad3d3c6-7712-4e21-bcbf-fadb8958cab3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:27.041298 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9ad3d3c6-7712-4e21-bcbf-fadb8958cab3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:27.041743 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9ad3d3c6-7712-4e21-bcbf-fadb8958cab3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:27.042564 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9ad3d3c6-7712-4e21-bcbf-fadb8958cab3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:27.043000 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9ad3d3c6-7712-4e21-bcbf-fadb8958cab3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:27.189569 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9ad3d3c6-7712-4e21-bcbf-fadb8958cab3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:27.197207 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9ad3d3c6-7712-4e21-bcbf-fadb8958cab3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1513 microversion: 2.1 time: 0.167247 Apr 12 00:29:27.198188 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 217/445] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:27 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:28.181623 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-52b8d5d6-9542-4e22-8e6a-7d003657b201 req-8c878db3-c2a6-4b1d-8d04-ae10ab54d4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6443b855-1525-4e40-bfa0-a16e1c2de983", "name": "network-vif-deleted", "tag": "031c6bd4-83ae-48dd-b676-61131c7d8178"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:28.190239 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-52b8d5d6-9542-4e22-8e6a-7d003657b201 req-8c878db3-c2a6-4b1d-8d04-ae10ab54d4a6 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:28.191229 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-52b8d5d6-9542-4e22-8e6a-7d003657b201 req-8c878db3-c2a6-4b1d-8d04-ae10ab54d4a6 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:28.205351 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-52b8d5d6-9542-4e22-8e6a-7d003657b201 req-8c878db3-c2a6-4b1d-8d04-ae10ab54d4a6 service nova] Creating event network-vif-deleted:031c6bd4-83ae-48dd-b676-61131c7d8178 for instance 6443b855-1525-4e40-bfa0-a16e1c2de983 on hv-cinder-83625 Apr 12 00:29:28.212636 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-52b8d5d6-9542-4e22-8e6a-7d003657b201 req-8c878db3-c2a6-4b1d-8d04-ae10ab54d4a6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035439 Apr 12 00:29:28.213511 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 229/446] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:29:28.222970 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-78036e0e-897e-4837-93ff-8cc2bc9c6b53 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:28.225485 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-78036e0e-897e-4837-93ff-8cc2bc9c6b53 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:28.238244 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-78036e0e-897e-4837-93ff-8cc2bc9c6b53 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:28.239072 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-78036e0e-897e-4837-93ff-8cc2bc9c6b53 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:28.242757 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-78036e0e-897e-4837-93ff-8cc2bc9c6b53 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:28.243457 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-78036e0e-897e-4837-93ff-8cc2bc9c6b53 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:28.325382 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-78036e0e-897e-4837-93ff-8cc2bc9c6b53 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:28.334277 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-78036e0e-897e-4837-93ff-8cc2bc9c6b53 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 200 len: 1304 microversion: 2.1 time: 0.121874 Apr 12 00:29:28.334478 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 218/447] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:28 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:29.351808 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-d24c57d4-a419-452f-ae2f-1cab35d4ea70 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:29.352694 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-d24c57d4-a419-452f-ae2f-1cab35d4ea70 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: 6443b855-1525-4e40-bfa0-a16e1c2de983] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:29.359695 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d24c57d4-a419-452f-ae2f-1cab35d4ea70 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:29.360143 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d24c57d4-a419-452f-ae2f-1cab35d4ea70 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:29.361182 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d24c57d4-a419-452f-ae2f-1cab35d4ea70 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:29.361553 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d24c57d4-a419-452f-ae2f-1cab35d4ea70 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:29.376454 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-d24c57d4-a419-452f-ae2f-1cab35d4ea70 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] HTTP exception thrown: Instance 6443b855-1525-4e40-bfa0-a16e1c2de983 could not be found. Apr 12 00:29:29.377039 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-d24c57d4-a419-452f-ae2f-1cab35d4ea70 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Returning 404 to user: Instance 6443b855-1525-4e40-bfa0-a16e1c2de983 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:29:29.377874 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-d24c57d4-a419-452f-ae2f-1cab35d4ea70 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983" status: 404 len: 111 microversion: 2.1 time: 0.030381 Apr 12 00:29:29.378714 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 230/448] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:29 2022] GET /compute/v2.1/servers/6443b855-1525-4e40-bfa0-a16e1c2de983 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:29:35.287392 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5f911746-9b09-48ca-b650-b340b974ad5c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-997376135", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-147522559", "security_groups": [{"name": "tempest-secgroup-smoke-262539506"}], "networks": [{"uuid": "24ec2ef9-df24-4555-83f6-8552434e4e0b"}], "block_device_mapping_v2": [{"uuid": "5f88d679-f99f-44c0-8f5b-9899485f66d1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:35.424042 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.network.neutron [None req-5f911746-9b09-48ca-b650-b340b974ad5c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] validate_networks() for [('24ec2ef9-df24-4555-83f6-8552434e4e0b', None, None, None, None, None)] {{(pid=128487) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:29:35.869189 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-5f911746-9b09-48ca-b650-b340b974ad5c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Flavor limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:29:35.869610 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-5f911746-9b09-48ca-b650-b340b974ad5c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Image limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:29:35.870148 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-5f911746-9b09-48ca-b650-b340b974ad5c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Flavor pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:29:35.870491 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-5f911746-9b09-48ca-b650-b340b974ad5c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Image pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:29:35.870982 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-5f911746-9b09-48ca-b650-b340b974ad5c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:29:35.882880 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5f911746-9b09-48ca-b650-b340b974ad5c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:35.883322 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5f911746-9b09-48ca-b650-b340b974ad5c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:35.884116 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5f911746-9b09-48ca-b650-b340b974ad5c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:35.884542 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5f911746-9b09-48ca-b650-b340b974ad5c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:35.909624 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-5f911746-9b09-48ca-b650-b340b974ad5c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Getting quotas for project c03f71e524b24b8abf5e7c81842f4e75. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:29:35.914745 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-5f911746-9b09-48ca-b650-b340b974ad5c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Getting quotas for user 8ee7971dfb4e4c22aac3d97db9ee04d0 and project c03f71e524b24b8abf5e7c81842f4e75. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:29:35.980540 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5f911746-9b09-48ca-b650-b340b974ad5c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Going to run 1 instances... {{(pid=128487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:29:35.982789 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5f911746-9b09-48ca-b650-b340b974ad5c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5f88d679-f99f-44c0-8f5b-9899485f66d1',volume_size=None,volume_type=None)] {{(pid=128487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:29:36.136690 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5f911746-9b09-48ca-b650-b340b974ad5c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.854198 Apr 12 00:29:36.137497 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 219/449] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:29:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:29:36.150213 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3217faae-b0f9-421d-b77c-c8ee91ae759d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:36.152144 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3217faae-b0f9-421d-b77c-c8ee91ae759d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:36.211253 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3217faae-b0f9-421d-b77c-c8ee91ae759d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:36.219234 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3217faae-b0f9-421d-b77c-c8ee91ae759d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1087 microversion: 2.1 time: 0.073033 Apr 12 00:29:36.220092 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 231/450] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:36 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1087 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:37.240885 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-25515725-6eb9-43b4-9e39-24891de64354 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:37.241926 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-25515725-6eb9-43b4-9e39-24891de64354 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:37.253432 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-25515725-6eb9-43b4-9e39-24891de64354 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:37.254926 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-25515725-6eb9-43b4-9e39-24891de64354 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:37.256728 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-25515725-6eb9-43b4-9e39-24891de64354 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:37.257491 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-25515725-6eb9-43b4-9e39-24891de64354 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:37.377350 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-25515725-6eb9-43b4-9e39-24891de64354 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:37.386843 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-25515725-6eb9-43b4-9e39-24891de64354 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1185 microversion: 2.1 time: 0.153559 Apr 12 00:29:37.387787 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 220/451] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:37 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:38.405763 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a56412db-252b-49d4-a97f-93c2b70faa5e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:38.407057 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a56412db-252b-49d4-a97f-93c2b70faa5e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:38.414043 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a56412db-252b-49d4-a97f-93c2b70faa5e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:38.414787 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a56412db-252b-49d4-a97f-93c2b70faa5e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:38.415717 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a56412db-252b-49d4-a97f-93c2b70faa5e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:38.416319 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a56412db-252b-49d4-a97f-93c2b70faa5e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:38.479557 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a56412db-252b-49d4-a97f-93c2b70faa5e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:38.487938 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a56412db-252b-49d4-a97f-93c2b70faa5e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1203 microversion: 2.1 time: 0.086592 Apr 12 00:29:38.488881 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 232/452] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:38 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1203 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:39.503986 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-38dcc339-4be3-405b-806d-15c9f3c3c36d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:39.504585 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-38dcc339-4be3-405b-806d-15c9f3c3c36d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:39.510907 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-38dcc339-4be3-405b-806d-15c9f3c3c36d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:39.511347 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-38dcc339-4be3-405b-806d-15c9f3c3c36d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:39.512098 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-38dcc339-4be3-405b-806d-15c9f3c3c36d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:39.513059 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-38dcc339-4be3-405b-806d-15c9f3c3c36d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:39.571382 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-38dcc339-4be3-405b-806d-15c9f3c3c36d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:39.578946 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-38dcc339-4be3-405b-806d-15c9f3c3c36d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1203 microversion: 2.1 time: 0.078762 Apr 12 00:29:39.579502 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 221/453] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:39 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1203 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:40.595390 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-af30e0ee-0971-4419-b619-12d18affd170 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:40.595997 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-af30e0ee-0971-4419-b619-12d18affd170 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:40.602218 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-af30e0ee-0971-4419-b619-12d18affd170 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:40.602697 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-af30e0ee-0971-4419-b619-12d18affd170 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:40.603453 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-af30e0ee-0971-4419-b619-12d18affd170 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:40.603885 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-af30e0ee-0971-4419-b619-12d18affd170 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:40.665195 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-af30e0ee-0971-4419-b619-12d18affd170 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:40.673084 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-af30e0ee-0971-4419-b619-12d18affd170 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1203 microversion: 2.1 time: 0.081545 Apr 12 00:29:40.673641 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 233/454] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:40 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1203 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:41.689530 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-0daa9834-73cc-4049-865d-b7a0bbf3166d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:41.690131 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-0daa9834-73cc-4049-865d-b7a0bbf3166d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:41.699987 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0daa9834-73cc-4049-865d-b7a0bbf3166d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:41.700843 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0daa9834-73cc-4049-865d-b7a0bbf3166d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:41.702149 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0daa9834-73cc-4049-865d-b7a0bbf3166d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:41.702702 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0daa9834-73cc-4049-865d-b7a0bbf3166d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:41.711565 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-518d82e7-e723-4af2-ae3e-fbdac9c42a24 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:41.712188 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-518d82e7-e723-4af2-ae3e-fbdac9c42a24 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:41.718652 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-518d82e7-e723-4af2-ae3e-fbdac9c42a24 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:41.719097 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-518d82e7-e723-4af2-ae3e-fbdac9c42a24 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:41.719850 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-518d82e7-e723-4af2-ae3e-fbdac9c42a24 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:41.720541 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-518d82e7-e723-4af2-ae3e-fbdac9c42a24 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:41.744904 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-518d82e7-e723-4af2-ae3e-fbdac9c42a24 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/ips" status: 200 len: 152 microversion: 2.20 time: 0.037257 Apr 12 00:29:41.745479 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 234/455] 10.222.0.32 () {60 vars in 1288 bytes} [Tue Apr 12 00:29:41 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 00:29:41.785792 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-0daa9834-73cc-4049-865d-b7a0bbf3166d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:41.793124 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-0daa9834-73cc-4049-865d-b7a0bbf3166d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1203 microversion: 2.1 time: 0.107339 Apr 12 00:29:41.794677 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 222/456] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:41 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1203 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:42.811523 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-37f8fe40-c20f-44cc-bcc1-c9d636ca7d43 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:42.812084 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-37f8fe40-c20f-44cc-bcc1-c9d636ca7d43 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:42.817875 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-37f8fe40-c20f-44cc-bcc1-c9d636ca7d43 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:42.818366 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-37f8fe40-c20f-44cc-bcc1-c9d636ca7d43 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:42.819149 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-37f8fe40-c20f-44cc-bcc1-c9d636ca7d43 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:42.819580 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-37f8fe40-c20f-44cc-bcc1-c9d636ca7d43 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:42.970691 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-37f8fe40-c20f-44cc-bcc1-c9d636ca7d43 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:42.979389 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-37f8fe40-c20f-44cc-bcc1-c9d636ca7d43 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1270 microversion: 2.1 time: 0.172245 Apr 12 00:29:42.979978 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 235/457] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:42 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:43.485450 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-420c515b-b606-49d6-bc3e-e2f285ea93ea tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1925247750", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452", "networks": [{"uuid": "56b7f3f4-fbda-4e53-9444-e45c08b83dce"}]}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:43.489594 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-ce3a3fa9-dd35-4ee4-8473-2f377401646e req-7bdb1b3c-855e-47c9-9a56-64b5c6c9d676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29aa1426-1684-47b1-aded-1c9c306543bc", "tag": "94406837-92d7-472c-9764-43cc0c5b4cd8"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:43.503941 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-ce3a3fa9-dd35-4ee4-8473-2f377401646e req-7bdb1b3c-855e-47c9-9a56-64b5c6c9d676 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:43.504376 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-ce3a3fa9-dd35-4ee4-8473-2f377401646e req-7bdb1b3c-855e-47c9-9a56-64b5c6c9d676 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:43.525633 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-ce3a3fa9-dd35-4ee4-8473-2f377401646e req-7bdb1b3c-855e-47c9-9a56-64b5c6c9d676 service nova] Creating event network-changed:94406837-92d7-472c-9764-43cc0c5b4cd8 for instance 29aa1426-1684-47b1-aded-1c9c306543bc on hv-cinder-83625 Apr 12 00:29:43.533334 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-ce3a3fa9-dd35-4ee4-8473-2f377401646e req-7bdb1b3c-855e-47c9-9a56-64b5c6c9d676 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048810 Apr 12 00:29:43.534895 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 236/458] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:29:43.572488 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.network.neutron [None req-420c515b-b606-49d6-bc3e-e2f285ea93ea tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] validate_networks() for [('56b7f3f4-fbda-4e53-9444-e45c08b83dce', None, None, None, None, None)] {{(pid=128487) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:29:43.997142 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b8a41ba3-6531-4b05-9f3e-3711af953d34 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:43.998556 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b8a41ba3-6531-4b05-9f3e-3711af953d34 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:44.008394 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b8a41ba3-6531-4b05-9f3e-3711af953d34 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:44.009073 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b8a41ba3-6531-4b05-9f3e-3711af953d34 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:44.010021 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b8a41ba3-6531-4b05-9f3e-3711af953d34 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:44.011136 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b8a41ba3-6531-4b05-9f3e-3711af953d34 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:44.163273 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b8a41ba3-6531-4b05-9f3e-3711af953d34 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:44.171182 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b8a41ba3-6531-4b05-9f3e-3711af953d34 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1270 microversion: 2.1 time: 0.178630 Apr 12 00:29:44.171799 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 237/459] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:43 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:29:44.233417 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-420c515b-b606-49d6-bc3e-e2f285ea93ea tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Flavor limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:29:44.234077 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-420c515b-b606-49d6-bc3e-e2f285ea93ea tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Image limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:29:44.234574 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-420c515b-b606-49d6-bc3e-e2f285ea93ea tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Flavor pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:29:44.234978 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-420c515b-b606-49d6-bc3e-e2f285ea93ea tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Image pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:29:44.235552 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-420c515b-b606-49d6-bc3e-e2f285ea93ea tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:29:44.245393 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-420c515b-b606-49d6-bc3e-e2f285ea93ea tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:44.245889 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-420c515b-b606-49d6-bc3e-e2f285ea93ea tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:44.246742 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-420c515b-b606-49d6-bc3e-e2f285ea93ea tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:44.247179 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-420c515b-b606-49d6-bc3e-e2f285ea93ea tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:44.266766 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-420c515b-b606-49d6-bc3e-e2f285ea93ea tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Getting quotas for project 4d829832a67942c89c33adf4eea0df20. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:29:44.271615 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-420c515b-b606-49d6-bc3e-e2f285ea93ea tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Getting quotas for user d01c35b046284938a73d4404234c1f24 and project 4d829832a67942c89c33adf4eea0df20. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:29:44.283512 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-420c515b-b606-49d6-bc3e-e2f285ea93ea tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Going to run 1 instances... {{(pid=128487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:29:44.285677 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-420c515b-b606-49d6-bc3e-e2f285ea93ea tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:29:44.334351 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-420c515b-b606-49d6-bc3e-e2f285ea93ea tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.854731 Apr 12 00:29:44.335268 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 223/460] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:29:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:29:44.345873 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3c94c663-f1d1-4891-86d5-65fac74f5d86 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:44.346566 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3c94c663-f1d1-4891-86d5-65fac74f5d86 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:44.402679 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3c94c663-f1d1-4891-86d5-65fac74f5d86 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:44.410196 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3c94c663-f1d1-4891-86d5-65fac74f5d86 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1219 microversion: 2.1 time: 0.068303 Apr 12 00:29:44.410816 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 238/461] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:44 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:44.898174 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5de168f3-f679-4825-bb6e-efb8c1edce0d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:44.898748 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5de168f3-f679-4825-bb6e-efb8c1edce0d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:44.905529 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5de168f3-f679-4825-bb6e-efb8c1edce0d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:44.905976 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5de168f3-f679-4825-bb6e-efb8c1edce0d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:44.906762 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5de168f3-f679-4825-bb6e-efb8c1edce0d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:44.907192 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5de168f3-f679-4825-bb6e-efb8c1edce0d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:44.929454 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-5de168f3-f679-4825-bb6e-efb8c1edce0d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lazy-loading 'flavor' on Instance uuid 02c4e615-6c86-41a2-b6a5-19371b76e311 {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:29:45.180683 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5de168f3-f679-4825-bb6e-efb8c1edce0d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "POST /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/action" status: 202 len: 0 microversion: 2.20 time: 0.286549 Apr 12 00:29:45.181311 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 224/462] 10.222.0.32 () {62 vars in 1318 bytes} [Tue Apr 12 00:29:44 2022] POST /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:29:45.188190 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-51082498-87ef-469b-9a69-7107f899d96f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:45.188972 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-51082498-87ef-469b-9a69-7107f899d96f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:45.191577 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-252c44e3-0a36-497f-912f-df597b460d35 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:45.192352 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-252c44e3-0a36-497f-912f-df597b460d35 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:45.196352 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-51082498-87ef-469b-9a69-7107f899d96f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:45.196802 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-51082498-87ef-469b-9a69-7107f899d96f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:45.199170 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-252c44e3-0a36-497f-912f-df597b460d35 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:45.200133 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-252c44e3-0a36-497f-912f-df597b460d35 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:45.201258 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-252c44e3-0a36-497f-912f-df597b460d35 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:45.201401 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-51082498-87ef-469b-9a69-7107f899d96f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:45.201737 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-252c44e3-0a36-497f-912f-df597b460d35 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:45.201858 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-51082498-87ef-469b-9a69-7107f899d96f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:45.365981 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-51082498-87ef-469b-9a69-7107f899d96f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:45.374443 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-51082498-87ef-469b-9a69-7107f899d96f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1258 microversion: 2.1 time: 0.189939 Apr 12 00:29:45.375100 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 239/463] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:45 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1258 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:29:45.403894 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-252c44e3-0a36-497f-912f-df597b460d35 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:45.412178 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-252c44e3-0a36-497f-912f-df597b460d35 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:45.413620 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-252c44e3-0a36-497f-912f-df597b460d35 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:45.414806 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-252c44e3-0a36-497f-912f-df597b460d35 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1722 microversion: 2.20 time: 0.227628 Apr 12 00:29:45.415369 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 225/464] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:29:45 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:29:45.427611 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-abbc7462-32ed-447c-a755-8e9f5c2c170f tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:45.428406 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-abbc7462-32ed-447c-a755-8e9f5c2c170f tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:45.434879 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-abbc7462-32ed-447c-a755-8e9f5c2c170f tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:45.435304 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-abbc7462-32ed-447c-a755-8e9f5c2c170f tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:45.436065 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-abbc7462-32ed-447c-a755-8e9f5c2c170f tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:45.436496 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-abbc7462-32ed-447c-a755-8e9f5c2c170f tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:45.496006 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-abbc7462-32ed-447c-a755-8e9f5c2c170f tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:45.503879 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-abbc7462-32ed-447c-a755-8e9f5c2c170f tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1223 microversion: 2.1 time: 0.080189 Apr 12 00:29:45.504629 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 240/465] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:45 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:46.391134 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3c6e9766-f864-46d1-94fc-cdbe7bebd55a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:46.391828 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3c6e9766-f864-46d1-94fc-cdbe7bebd55a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:46.398898 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3c6e9766-f864-46d1-94fc-cdbe7bebd55a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:46.399447 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3c6e9766-f864-46d1-94fc-cdbe7bebd55a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:46.400360 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3c6e9766-f864-46d1-94fc-cdbe7bebd55a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:46.400829 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3c6e9766-f864-46d1-94fc-cdbe7bebd55a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:46.432716 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5bfb7feb-24fc-42d3-b03e-1a731290258c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:46.433324 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5bfb7feb-24fc-42d3-b03e-1a731290258c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:46.440040 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5bfb7feb-24fc-42d3-b03e-1a731290258c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:46.440495 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5bfb7feb-24fc-42d3-b03e-1a731290258c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:46.441268 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5bfb7feb-24fc-42d3-b03e-1a731290258c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:46.441701 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5bfb7feb-24fc-42d3-b03e-1a731290258c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:46.550165 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-3c6e9766-f864-46d1-94fc-cdbe7bebd55a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:46.558432 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3c6e9766-f864-46d1-94fc-cdbe7bebd55a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1258 microversion: 2.1 time: 0.170871 Apr 12 00:29:46.559019 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 226/466] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:46 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:46.566952 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2984d395-06e5-4976-bc87-f49a0b511669 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:46.567785 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2984d395-06e5-4976-bc87-f49a0b511669 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:46.573701 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2984d395-06e5-4976-bc87-f49a0b511669 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:46.574219 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2984d395-06e5-4976-bc87-f49a0b511669 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:46.575302 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2984d395-06e5-4976-bc87-f49a0b511669 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:46.576131 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2984d395-06e5-4976-bc87-f49a0b511669 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:46.587531 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5bfb7feb-24fc-42d3-b03e-1a731290258c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:46.595622 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5bfb7feb-24fc-42d3-b03e-1a731290258c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:46.597161 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5bfb7feb-24fc-42d3-b03e-1a731290258c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:46.598341 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5bfb7feb-24fc-42d3-b03e-1a731290258c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1722 microversion: 2.20 time: 0.169452 Apr 12 00:29:46.598899 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 241/467] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:29:46 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:29:46.635624 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2984d395-06e5-4976-bc87-f49a0b511669 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:46.643707 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2984d395-06e5-4976-bc87-f49a0b511669 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1215 microversion: 2.1 time: 0.080277 Apr 12 00:29:46.644274 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 227/468] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:46 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:47.576976 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b7734af9-9758-418d-b532-e6258f47f60c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:47.577602 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b7734af9-9758-418d-b532-e6258f47f60c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:47.584256 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b7734af9-9758-418d-b532-e6258f47f60c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:47.584717 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b7734af9-9758-418d-b532-e6258f47f60c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:47.585536 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b7734af9-9758-418d-b532-e6258f47f60c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:47.586008 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b7734af9-9758-418d-b532-e6258f47f60c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:47.618669 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e17aadac-4e4a-4f4f-b57d-2c33f15e69f0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:47.619245 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e17aadac-4e4a-4f4f-b57d-2c33f15e69f0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:47.628826 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e17aadac-4e4a-4f4f-b57d-2c33f15e69f0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:47.629291 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e17aadac-4e4a-4f4f-b57d-2c33f15e69f0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:47.630614 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e17aadac-4e4a-4f4f-b57d-2c33f15e69f0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:47.631562 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e17aadac-4e4a-4f4f-b57d-2c33f15e69f0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:47.752045 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b7734af9-9758-418d-b532-e6258f47f60c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:47.764989 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b7734af9-9758-418d-b532-e6258f47f60c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1258 microversion: 2.1 time: 0.192791 Apr 12 00:29:47.765824 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 242/469] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:47 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1258 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:47.771400 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f65e429b-c4d7-4c78-8497-4fe87bcbd493 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:47.773006 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f65e429b-c4d7-4c78-8497-4fe87bcbd493 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:47.780256 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f65e429b-c4d7-4c78-8497-4fe87bcbd493 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:47.781113 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f65e429b-c4d7-4c78-8497-4fe87bcbd493 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:47.783145 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f65e429b-c4d7-4c78-8497-4fe87bcbd493 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:47.784497 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f65e429b-c4d7-4c78-8497-4fe87bcbd493 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:47.855046 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f65e429b-c4d7-4c78-8497-4fe87bcbd493 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:47.862648 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f65e429b-c4d7-4c78-8497-4fe87bcbd493 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1277 microversion: 2.1 time: 0.095625 Apr 12 00:29:47.863221 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 243/470] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:47 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:48.254663 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e17aadac-4e4a-4f4f-b57d-2c33f15e69f0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:48.263269 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e17aadac-4e4a-4f4f-b57d-2c33f15e69f0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:48.264707 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e17aadac-4e4a-4f4f-b57d-2c33f15e69f0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:48.265860 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e17aadac-4e4a-4f4f-b57d-2c33f15e69f0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1722 microversion: 2.20 time: 0.651511 Apr 12 00:29:48.266641 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 228/471] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:29:47 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1722 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:29:48.782689 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-21528864-1906-4157-8c48-2f97464e4a26 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:48.783310 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-21528864-1906-4157-8c48-2f97464e4a26 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:48.789670 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-21528864-1906-4157-8c48-2f97464e4a26 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:48.790120 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-21528864-1906-4157-8c48-2f97464e4a26 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:48.790913 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-21528864-1906-4157-8c48-2f97464e4a26 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:48.791353 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-21528864-1906-4157-8c48-2f97464e4a26 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:48.881597 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c18bece9-7bc9-4c3f-9d13-d9461a434eec tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:48.882874 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c18bece9-7bc9-4c3f-9d13-d9461a434eec tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:48.889998 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c18bece9-7bc9-4c3f-9d13-d9461a434eec tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:48.890678 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c18bece9-7bc9-4c3f-9d13-d9461a434eec tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:48.891623 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c18bece9-7bc9-4c3f-9d13-d9461a434eec tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:48.892225 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c18bece9-7bc9-4c3f-9d13-d9461a434eec tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:48.963941 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-21528864-1906-4157-8c48-2f97464e4a26 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:48.976037 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-21528864-1906-4157-8c48-2f97464e4a26 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1258 microversion: 2.1 time: 0.197282 Apr 12 00:29:48.976799 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 244/472] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:48 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1258 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:29:49.230818 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c18bece9-7bc9-4c3f-9d13-d9461a434eec tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:49.241472 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c18bece9-7bc9-4c3f-9d13-d9461a434eec tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1319 microversion: 2.1 time: 0.363628 Apr 12 00:29:49.251290 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 229/473] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:48 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:49.284770 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f9dce311-fab7-4de3-a55d-7ebb028b14eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:49.285622 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f9dce311-fab7-4de3-a55d-7ebb028b14eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:49.292079 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f9dce311-fab7-4de3-a55d-7ebb028b14eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:49.292696 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f9dce311-fab7-4de3-a55d-7ebb028b14eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:49.294481 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f9dce311-fab7-4de3-a55d-7ebb028b14eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:49.295130 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f9dce311-fab7-4de3-a55d-7ebb028b14eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:49.447871 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f9dce311-fab7-4de3-a55d-7ebb028b14eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:49.468052 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f9dce311-fab7-4de3-a55d-7ebb028b14eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:49.472555 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f9dce311-fab7-4de3-a55d-7ebb028b14eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:49.474020 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f9dce311-fab7-4de3-a55d-7ebb028b14eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1722 microversion: 2.20 time: 0.193690 Apr 12 00:29:49.474853 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 245/474] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:29:49 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:29:49.992990 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f48b3674-3489-4bc3-b40e-c25a0cedf09b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:49.994180 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f48b3674-3489-4bc3-b40e-c25a0cedf09b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:50.001250 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f48b3674-3489-4bc3-b40e-c25a0cedf09b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:50.001924 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f48b3674-3489-4bc3-b40e-c25a0cedf09b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:50.002741 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f48b3674-3489-4bc3-b40e-c25a0cedf09b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:50.003178 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f48b3674-3489-4bc3-b40e-c25a0cedf09b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:50.241760 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f48b3674-3489-4bc3-b40e-c25a0cedf09b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:50.249072 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f48b3674-3489-4bc3-b40e-c25a0cedf09b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1258 microversion: 2.1 time: 0.259923 Apr 12 00:29:50.249749 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 230/475] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:49 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1258 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:50.258334 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-982e96eb-bf44-4b29-8653-db9c00bb3f2a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:50.259577 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-982e96eb-bf44-4b29-8653-db9c00bb3f2a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:50.265752 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-982e96eb-bf44-4b29-8653-db9c00bb3f2a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:50.266211 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-982e96eb-bf44-4b29-8653-db9c00bb3f2a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:50.267081 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-982e96eb-bf44-4b29-8653-db9c00bb3f2a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:50.267447 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-982e96eb-bf44-4b29-8653-db9c00bb3f2a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:50.410871 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-982e96eb-bf44-4b29-8653-db9c00bb3f2a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:50.418880 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-982e96eb-bf44-4b29-8653-db9c00bb3f2a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1319 microversion: 2.1 time: 0.164108 Apr 12 00:29:50.419548 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 246/476] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:50 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:50.493034 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b69d14fc-de4d-405d-b301-a4ff6683e5b1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:50.493639 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b69d14fc-de4d-405d-b301-a4ff6683e5b1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:50.500454 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b69d14fc-de4d-405d-b301-a4ff6683e5b1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:50.500895 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b69d14fc-de4d-405d-b301-a4ff6683e5b1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:50.501689 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b69d14fc-de4d-405d-b301-a4ff6683e5b1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:50.502117 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b69d14fc-de4d-405d-b301-a4ff6683e5b1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:50.729450 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-a0f50723-b82b-43d6-b800-ec0f15779e06 req-d653dab2-a5bd-4100-996d-34093aebe9aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b845b619-f58f-4bfd-9a48-df1b1c742def", "tag": "d9cbe626-bf12-4a6f-94c5-36e54b08b033"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:50.750291 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-a0f50723-b82b-43d6-b800-ec0f15779e06 req-d653dab2-a5bd-4100-996d-34093aebe9aa service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:50.750925 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-a0f50723-b82b-43d6-b800-ec0f15779e06 req-d653dab2-a5bd-4100-996d-34093aebe9aa service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:50.761954 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-a0f50723-b82b-43d6-b800-ec0f15779e06 req-d653dab2-a5bd-4100-996d-34093aebe9aa service nova] Creating event network-changed:d9cbe626-bf12-4a6f-94c5-36e54b08b033 for instance b845b619-f58f-4bfd-9a48-df1b1c742def on hv-cinder-83625 Apr 12 00:29:50.767602 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-a0f50723-b82b-43d6-b800-ec0f15779e06 req-d653dab2-a5bd-4100-996d-34093aebe9aa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043073 Apr 12 00:29:50.768314 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 247/477] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:29:50.818363 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b69d14fc-de4d-405d-b301-a4ff6683e5b1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:50.830798 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b69d14fc-de4d-405d-b301-a4ff6683e5b1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:50.832878 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b69d14fc-de4d-405d-b301-a4ff6683e5b1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:50.834116 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b69d14fc-de4d-405d-b301-a4ff6683e5b1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1722 microversion: 2.20 time: 0.345058 Apr 12 00:29:50.834770 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 231/478] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:29:50 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1722 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:29:51.266882 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7adac749-7f5c-4036-8d05-397b187d45eb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:51.268189 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7adac749-7f5c-4036-8d05-397b187d45eb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:51.275795 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7adac749-7f5c-4036-8d05-397b187d45eb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:51.276408 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7adac749-7f5c-4036-8d05-397b187d45eb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:51.277346 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7adac749-7f5c-4036-8d05-397b187d45eb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:51.278585 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7adac749-7f5c-4036-8d05-397b187d45eb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:51.431566 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7adac749-7f5c-4036-8d05-397b187d45eb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:51.435814 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-cd354026-847f-434f-a453-226923c0a80b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:51.437087 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-cd354026-847f-434f-a453-226923c0a80b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:51.444710 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cd354026-847f-434f-a453-226923c0a80b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:51.445649 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cd354026-847f-434f-a453-226923c0a80b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:51.446721 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cd354026-847f-434f-a453-226923c0a80b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:51.447249 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cd354026-847f-434f-a453-226923c0a80b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:51.453665 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7adac749-7f5c-4036-8d05-397b187d45eb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1258 microversion: 2.1 time: 0.191300 Apr 12 00:29:51.465246 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 248/479] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:51 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1258 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:51.685872 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-cd354026-847f-434f-a453-226923c0a80b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:51.694074 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-cd354026-847f-434f-a453-226923c0a80b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1319 microversion: 2.1 time: 0.262923 Apr 12 00:29:51.706560 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 232/480] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:51 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:29:51.853162 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ed9580d4-12d1-425d-ae14-a9ac910eddef tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:51.854039 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ed9580d4-12d1-425d-ae14-a9ac910eddef tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:51.861213 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ed9580d4-12d1-425d-ae14-a9ac910eddef tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:51.861676 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ed9580d4-12d1-425d-ae14-a9ac910eddef tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:51.862481 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ed9580d4-12d1-425d-ae14-a9ac910eddef tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:51.862922 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ed9580d4-12d1-425d-ae14-a9ac910eddef tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:52.066552 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ed9580d4-12d1-425d-ae14-a9ac910eddef tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:52.075595 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ed9580d4-12d1-425d-ae14-a9ac910eddef tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:52.077596 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ed9580d4-12d1-425d-ae14-a9ac910eddef tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:52.079195 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ed9580d4-12d1-425d-ae14-a9ac910eddef tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1722 microversion: 2.20 time: 0.230415 Apr 12 00:29:52.090430 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 249/481] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:29:51 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:29:52.473424 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-045278a9-218d-4e60-a81d-a7013b985af9 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:52.474104 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-045278a9-218d-4e60-a81d-a7013b985af9 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:52.482809 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-045278a9-218d-4e60-a81d-a7013b985af9 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:52.483528 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-045278a9-218d-4e60-a81d-a7013b985af9 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:52.484511 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-045278a9-218d-4e60-a81d-a7013b985af9 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:52.485044 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-045278a9-218d-4e60-a81d-a7013b985af9 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:52.709989 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-045278a9-218d-4e60-a81d-a7013b985af9 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:52.714510 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-941e0318-42df-4853-82d6-943eb925e800 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:52.714510 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-941e0318-42df-4853-82d6-943eb925e800 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:52.719599 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-941e0318-42df-4853-82d6-943eb925e800 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:52.720248 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-941e0318-42df-4853-82d6-943eb925e800 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:52.721025 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-941e0318-42df-4853-82d6-943eb925e800 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:52.721725 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-941e0318-42df-4853-82d6-943eb925e800 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:52.724068 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-045278a9-218d-4e60-a81d-a7013b985af9 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1258 microversion: 2.1 time: 0.256568 Apr 12 00:29:52.724950 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 233/482] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:52 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1258 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:52.868976 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-941e0318-42df-4853-82d6-943eb925e800 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:52.876603 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-941e0318-42df-4853-82d6-943eb925e800 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1319 microversion: 2.1 time: 0.168815 Apr 12 00:29:52.877170 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 250/483] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:52 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:29:53.097801 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d29ac270-3860-4b74-a319-468873d1daad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:53.098435 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d29ac270-3860-4b74-a319-468873d1daad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:53.104416 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d29ac270-3860-4b74-a319-468873d1daad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:53.104866 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d29ac270-3860-4b74-a319-468873d1daad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:53.105633 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d29ac270-3860-4b74-a319-468873d1daad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:53.106068 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d29ac270-3860-4b74-a319-468873d1daad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:53.254642 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d29ac270-3860-4b74-a319-468873d1daad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:53.262291 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d29ac270-3860-4b74-a319-468873d1daad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:53.263765 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d29ac270-3860-4b74-a319-468873d1daad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:53.264889 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d29ac270-3860-4b74-a319-468873d1daad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1722 microversion: 2.20 time: 0.171244 Apr 12 00:29:53.265655 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 234/484] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:29:53 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:29:53.744661 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-237d5c0c-7bb1-43ad-b87f-7b194701631b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:53.745369 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-237d5c0c-7bb1-43ad-b87f-7b194701631b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:53.752583 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-237d5c0c-7bb1-43ad-b87f-7b194701631b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:53.753018 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-237d5c0c-7bb1-43ad-b87f-7b194701631b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:53.753872 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-237d5c0c-7bb1-43ad-b87f-7b194701631b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:53.754299 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-237d5c0c-7bb1-43ad-b87f-7b194701631b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:53.893563 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c33f7276-a204-4222-9e8b-2d03c6feac1b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:53.895190 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c33f7276-a204-4222-9e8b-2d03c6feac1b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:53.904723 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c33f7276-a204-4222-9e8b-2d03c6feac1b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:53.905395 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c33f7276-a204-4222-9e8b-2d03c6feac1b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:53.906488 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c33f7276-a204-4222-9e8b-2d03c6feac1b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:53.907344 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c33f7276-a204-4222-9e8b-2d03c6feac1b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:53.921440 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-237d5c0c-7bb1-43ad-b87f-7b194701631b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:53.929804 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-237d5c0c-7bb1-43ad-b87f-7b194701631b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1258 microversion: 2.1 time: 0.192454 Apr 12 00:29:53.948666 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 251/485] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:53 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1258 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:54.072654 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c33f7276-a204-4222-9e8b-2d03c6feac1b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:54.079936 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c33f7276-a204-4222-9e8b-2d03c6feac1b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1319 microversion: 2.1 time: 0.190229 Apr 12 00:29:54.081559 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 235/486] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:53 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:29:54.285088 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ea1074f9-fd9b-4247-b919-7b20a4bf9286 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:54.285806 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ea1074f9-fd9b-4247-b919-7b20a4bf9286 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:54.292023 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ea1074f9-fd9b-4247-b919-7b20a4bf9286 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:54.292581 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ea1074f9-fd9b-4247-b919-7b20a4bf9286 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:54.293731 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ea1074f9-fd9b-4247-b919-7b20a4bf9286 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:54.294443 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ea1074f9-fd9b-4247-b919-7b20a4bf9286 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:54.601480 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ea1074f9-fd9b-4247-b919-7b20a4bf9286 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:54.610229 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ea1074f9-fd9b-4247-b919-7b20a4bf9286 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:54.612278 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ea1074f9-fd9b-4247-b919-7b20a4bf9286 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:54.613617 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ea1074f9-fd9b-4247-b919-7b20a4bf9286 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1722 microversion: 2.20 time: 0.333025 Apr 12 00:29:54.614335 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 252/487] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:29:54 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1722 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:29:54.947861 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-6ae57b9f-ffe8-4618-9f4d-ea81c99031e4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:54.949094 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-6ae57b9f-ffe8-4618-9f4d-ea81c99031e4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:54.956461 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6ae57b9f-ffe8-4618-9f4d-ea81c99031e4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:54.956984 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6ae57b9f-ffe8-4618-9f4d-ea81c99031e4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:54.957963 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6ae57b9f-ffe8-4618-9f4d-ea81c99031e4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:54.958494 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6ae57b9f-ffe8-4618-9f4d-ea81c99031e4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:55.099282 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-6ae57b9f-ffe8-4618-9f4d-ea81c99031e4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:55.099832 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-55c040c5-bff1-4f8b-ac61-fd19b63181e0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:55.100955 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-55c040c5-bff1-4f8b-ac61-fd19b63181e0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:55.108906 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-55c040c5-bff1-4f8b-ac61-fd19b63181e0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:55.109786 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-55c040c5-bff1-4f8b-ac61-fd19b63181e0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:55.111039 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-55c040c5-bff1-4f8b-ac61-fd19b63181e0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:55.111313 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-6ae57b9f-ffe8-4618-9f4d-ea81c99031e4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1258 microversion: 2.1 time: 0.167342 Apr 12 00:29:55.111791 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-55c040c5-bff1-4f8b-ac61-fd19b63181e0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:55.126526 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 236/488] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:54 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:55.282057 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-55c040c5-bff1-4f8b-ac61-fd19b63181e0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:55.291658 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-55c040c5-bff1-4f8b-ac61-fd19b63181e0 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1319 microversion: 2.1 time: 0.195860 Apr 12 00:29:55.294205 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 253/489] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:55 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:29:55.633061 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b876b638-7a15-4c06-8886-5d0769be2d4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:55.633659 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b876b638-7a15-4c06-8886-5d0769be2d4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:55.639919 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b876b638-7a15-4c06-8886-5d0769be2d4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:55.640592 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b876b638-7a15-4c06-8886-5d0769be2d4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:55.641362 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b876b638-7a15-4c06-8886-5d0769be2d4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:55.641795 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b876b638-7a15-4c06-8886-5d0769be2d4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:55.815194 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b876b638-7a15-4c06-8886-5d0769be2d4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:55.844217 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b876b638-7a15-4c06-8886-5d0769be2d4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:55.851085 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b876b638-7a15-4c06-8886-5d0769be2d4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:55.854813 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b876b638-7a15-4c06-8886-5d0769be2d4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1722 microversion: 2.20 time: 0.223132 Apr 12 00:29:55.856427 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 237/490] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:29:55 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:29:56.128653 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-11f1ecbe-5c35-4007-80af-0998adc7d4ff tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:56.129259 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-11f1ecbe-5c35-4007-80af-0998adc7d4ff tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:56.136234 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-11f1ecbe-5c35-4007-80af-0998adc7d4ff tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:56.136919 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-11f1ecbe-5c35-4007-80af-0998adc7d4ff tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:56.138447 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-11f1ecbe-5c35-4007-80af-0998adc7d4ff tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:56.139039 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-11f1ecbe-5c35-4007-80af-0998adc7d4ff tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:56.309927 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-bda5394e-9e68-41c2-8a49-a3054501cb86 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:56.312426 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-bda5394e-9e68-41c2-8a49-a3054501cb86 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:56.324131 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bda5394e-9e68-41c2-8a49-a3054501cb86 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:56.324968 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bda5394e-9e68-41c2-8a49-a3054501cb86 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:56.326230 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bda5394e-9e68-41c2-8a49-a3054501cb86 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:56.326999 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bda5394e-9e68-41c2-8a49-a3054501cb86 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:56.425767 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-11f1ecbe-5c35-4007-80af-0998adc7d4ff tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:56.434812 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-11f1ecbe-5c35-4007-80af-0998adc7d4ff tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1258 microversion: 2.1 time: 0.309278 Apr 12 00:29:56.443285 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 254/491] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:56 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1258 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:56.878312 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-6055b533-445f-463c-b8b3-fd72c414fd2d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:56.880504 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-6055b533-445f-463c-b8b3-fd72c414fd2d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:56.892603 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6055b533-445f-463c-b8b3-fd72c414fd2d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:56.893430 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6055b533-445f-463c-b8b3-fd72c414fd2d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:56.895589 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6055b533-445f-463c-b8b3-fd72c414fd2d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:56.897481 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6055b533-445f-463c-b8b3-fd72c414fd2d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:56.929354 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-bda5394e-9e68-41c2-8a49-a3054501cb86 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:56.946366 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-bda5394e-9e68-41c2-8a49-a3054501cb86 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1319 microversion: 2.1 time: 0.640820 Apr 12 00:29:56.961054 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 238/492] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:56 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1319 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:57.458572 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-58e4d9a3-56a9-428b-9530-5e7315e73dd2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:57.459221 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-58e4d9a3-56a9-428b-9530-5e7315e73dd2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:57.470404 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-58e4d9a3-56a9-428b-9530-5e7315e73dd2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:57.471112 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-58e4d9a3-56a9-428b-9530-5e7315e73dd2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:57.471947 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-58e4d9a3-56a9-428b-9530-5e7315e73dd2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:57.472383 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-58e4d9a3-56a9-428b-9530-5e7315e73dd2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:57.520613 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-6055b533-445f-463c-b8b3-fd72c414fd2d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:57.530571 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-6055b533-445f-463c-b8b3-fd72c414fd2d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:57.532811 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-6055b533-445f-463c-b8b3-fd72c414fd2d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:57.538805 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-6055b533-445f-463c-b8b3-fd72c414fd2d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1722 microversion: 2.20 time: 0.665050 Apr 12 00:29:57.540463 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 255/493] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:29:56 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1722 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:29:57.739452 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-58e4d9a3-56a9-428b-9530-5e7315e73dd2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:57.754800 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-58e4d9a3-56a9-428b-9530-5e7315e73dd2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1258 microversion: 2.1 time: 0.301989 Apr 12 00:29:57.756102 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 239/494] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:57 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1258 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:57.969593 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-6dfab957-c0b7-4b64-b1b1-fa27ceee340a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:57.970509 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-6dfab957-c0b7-4b64-b1b1-fa27ceee340a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:57.979885 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6dfab957-c0b7-4b64-b1b1-fa27ceee340a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:57.982022 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6dfab957-c0b7-4b64-b1b1-fa27ceee340a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:57.983094 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6dfab957-c0b7-4b64-b1b1-fa27ceee340a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:57.988764 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6dfab957-c0b7-4b64-b1b1-fa27ceee340a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:58.285344 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-6dfab957-c0b7-4b64-b1b1-fa27ceee340a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:58.297379 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-6dfab957-c0b7-4b64-b1b1-fa27ceee340a tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1319 microversion: 2.1 time: 0.337712 Apr 12 00:29:58.298018 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 256/495] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:57 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:58.563926 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c2e008a4-45c4-4001-9298-2fc6f0aae92a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:58.564928 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c2e008a4-45c4-4001-9298-2fc6f0aae92a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:58.571995 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c2e008a4-45c4-4001-9298-2fc6f0aae92a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:58.572799 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c2e008a4-45c4-4001-9298-2fc6f0aae92a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:58.573672 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c2e008a4-45c4-4001-9298-2fc6f0aae92a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:58.574118 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c2e008a4-45c4-4001-9298-2fc6f0aae92a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:58.775294 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2c3a0869-cf0b-4937-9477-2356b39f979b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:58.776688 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-2c3a0869-cf0b-4937-9477-2356b39f979b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:58.786629 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2c3a0869-cf0b-4937-9477-2356b39f979b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:58.787433 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2c3a0869-cf0b-4937-9477-2356b39f979b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:58.788486 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2c3a0869-cf0b-4937-9477-2356b39f979b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:58.789117 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2c3a0869-cf0b-4937-9477-2356b39f979b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:58.820857 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c2e008a4-45c4-4001-9298-2fc6f0aae92a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:58.830126 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c2e008a4-45c4-4001-9298-2fc6f0aae92a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:58.833137 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c2e008a4-45c4-4001-9298-2fc6f0aae92a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:58.834523 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c2e008a4-45c4-4001-9298-2fc6f0aae92a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1743 microversion: 2.20 time: 0.279969 Apr 12 00:29:58.835572 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 240/496] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:29:58 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1743 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:29:58.982535 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2c3a0869-cf0b-4937-9477-2356b39f979b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:58.993908 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2c3a0869-cf0b-4937-9477-2356b39f979b tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1258 microversion: 2.1 time: 0.223011 Apr 12 00:29:58.994803 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 257/497] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:58 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1258 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:29:59.153972 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-5a05423a-28b0-4df9-b47c-db7683b55284 req-7c9a09ca-e6af-4e47-96ba-9796cd468657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29aa1426-1684-47b1-aded-1c9c306543bc", "name": "network-vif-plugged", "status": "completed", "tag": "94406837-92d7-472c-9764-43cc0c5b4cd8"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:59.174107 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-5a05423a-28b0-4df9-b47c-db7683b55284 req-7c9a09ca-e6af-4e47-96ba-9796cd468657 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:59.174644 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-5a05423a-28b0-4df9-b47c-db7683b55284 req-7c9a09ca-e6af-4e47-96ba-9796cd468657 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:59.199682 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-5a05423a-28b0-4df9-b47c-db7683b55284 req-7c9a09ca-e6af-4e47-96ba-9796cd468657 service nova] Creating event network-vif-plugged:94406837-92d7-472c-9764-43cc0c5b4cd8 for instance 29aa1426-1684-47b1-aded-1c9c306543bc on hv-cinder-83625 Apr 12 00:29:59.206289 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-5a05423a-28b0-4df9-b47c-db7683b55284 req-7c9a09ca-e6af-4e47-96ba-9796cd468657 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056890 Apr 12 00:29:59.207167 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 258/498] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:29:59.301197 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-6ccbefac-615c-4ae1-aad3-afd3e6cfb4f3 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Action: 'create', calling method: .version_select at 0x7f64e128d280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-989695835"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:59.317654 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-80f973b9-7218-4525-8fb6-1263fe0cbd8d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:59.318404 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-80f973b9-7218-4525-8fb6-1263fe0cbd8d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:59.325546 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-80f973b9-7218-4525-8fb6-1263fe0cbd8d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:59.326537 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-80f973b9-7218-4525-8fb6-1263fe0cbd8d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:59.326847 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-6ccbefac-615c-4ae1-aad3-afd3e6cfb4f3 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Getting quotas for project 4ad54dac63374c8a9b4da55ee5dc7fd1. Resources: {'key_pairs'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:29:59.327769 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-80f973b9-7218-4525-8fb6-1263fe0cbd8d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:59.328401 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-80f973b9-7218-4525-8fb6-1263fe0cbd8d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:59.336723 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-6ccbefac-615c-4ae1-aad3-afd3e6cfb4f3 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Getting quotas for user 3b1d212dad5347a888832a779beadece and project 4ad54dac63374c8a9b4da55ee5dc7fd1. Resources: {'key_pairs'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:29:59.508300 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-80f973b9-7218-4525-8fb6-1263fe0cbd8d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:29:59.517583 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-80f973b9-7218-4525-8fb6-1263fe0cbd8d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1319 microversion: 2.1 time: 0.205736 Apr 12 00:29:59.518415 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 259/499] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:29:59 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:29:59.596523 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-6ccbefac-615c-4ae1-aad3-afd3e6cfb4f3 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Getting quotas for project 4ad54dac63374c8a9b4da55ee5dc7fd1. Resources: {'key_pairs'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:29:59.600609 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-6ccbefac-615c-4ae1-aad3-afd3e6cfb4f3 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Getting quotas for user 3b1d212dad5347a888832a779beadece and project 4ad54dac63374c8a9b4da55ee5dc7fd1. Resources: {'key_pairs'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:29:59.616003 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-6ccbefac-615c-4ae1-aad3-afd3e6cfb4f3 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.535598 Apr 12 00:29:59.616681 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 241/500] 10.222.0.32 () {60 vars in 1157 bytes} [Tue Apr 12 00:29:59 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:59.853565 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2f6e6409-915e-4fb9-9431-e91f00b0bb49 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:59.854458 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-2f6e6409-915e-4fb9-9431-e91f00b0bb49 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:29:59.860715 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2f6e6409-915e-4fb9-9431-e91f00b0bb49 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:59.861260 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2f6e6409-915e-4fb9-9431-e91f00b0bb49 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:29:59.862044 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2f6e6409-915e-4fb9-9431-e91f00b0bb49 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:29:59.862645 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2f6e6409-915e-4fb9-9431-e91f00b0bb49 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:00.011390 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-06add01e-e092-473b-8a1a-67b5b19a1435 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:00.012077 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-06add01e-e092-473b-8a1a-67b5b19a1435 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:00.017947 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-06add01e-e092-473b-8a1a-67b5b19a1435 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:00.018436 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-06add01e-e092-473b-8a1a-67b5b19a1435 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:00.019391 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-06add01e-e092-473b-8a1a-67b5b19a1435 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:00.019829 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-06add01e-e092-473b-8a1a-67b5b19a1435 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:00.048854 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2f6e6409-915e-4fb9-9431-e91f00b0bb49 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:00.057625 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2f6e6409-915e-4fb9-9431-e91f00b0bb49 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:00.059323 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2f6e6409-915e-4fb9-9431-e91f00b0bb49 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:00.061180 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2f6e6409-915e-4fb9-9431-e91f00b0bb49 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1743 microversion: 2.20 time: 0.211605 Apr 12 00:30:00.065811 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 260/501] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:29:59 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1743 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:00.162343 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-06add01e-e092-473b-8a1a-67b5b19a1435 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:00.170117 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-06add01e-e092-473b-8a1a-67b5b19a1435 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1258 microversion: 2.1 time: 0.162711 Apr 12 00:30:00.170728 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 242/502] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:00 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:00.535061 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-924828ab-6cf9-47ba-ba02-419ab6d3cad3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:00.535672 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-924828ab-6cf9-47ba-ba02-419ab6d3cad3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:00.542621 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-924828ab-6cf9-47ba-ba02-419ab6d3cad3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:00.543803 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-924828ab-6cf9-47ba-ba02-419ab6d3cad3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:00.544788 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-924828ab-6cf9-47ba-ba02-419ab6d3cad3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:00.545222 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-924828ab-6cf9-47ba-ba02-419ab6d3cad3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:00.702280 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-924828ab-6cf9-47ba-ba02-419ab6d3cad3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:00.710732 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-924828ab-6cf9-47ba-ba02-419ab6d3cad3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1319 microversion: 2.1 time: 0.179431 Apr 12 00:30:00.711300 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 261/503] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:00 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:01.086550 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-126c789b-bd75-4fbe-9a7c-ae504825a846 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:01.087790 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-126c789b-bd75-4fbe-9a7c-ae504825a846 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:01.099939 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-126c789b-bd75-4fbe-9a7c-ae504825a846 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:01.100545 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-126c789b-bd75-4fbe-9a7c-ae504825a846 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:01.102407 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-126c789b-bd75-4fbe-9a7c-ae504825a846 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:01.103344 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-126c789b-bd75-4fbe-9a7c-ae504825a846 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:01.187539 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e7d47455-0254-4569-9d03-9b5ee584325e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:01.188153 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e7d47455-0254-4569-9d03-9b5ee584325e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:01.195014 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e7d47455-0254-4569-9d03-9b5ee584325e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:01.195724 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e7d47455-0254-4569-9d03-9b5ee584325e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:01.197548 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e7d47455-0254-4569-9d03-9b5ee584325e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:01.198136 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e7d47455-0254-4569-9d03-9b5ee584325e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:01.268850 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-126c789b-bd75-4fbe-9a7c-ae504825a846 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:01.282915 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-126c789b-bd75-4fbe-9a7c-ae504825a846 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:01.284609 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-126c789b-bd75-4fbe-9a7c-ae504825a846 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:01.286061 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-126c789b-bd75-4fbe-9a7c-ae504825a846 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1743 microversion: 2.20 time: 0.206672 Apr 12 00:30:01.287205 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 243/504] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:01 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1743 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:01.384103 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e7d47455-0254-4569-9d03-9b5ee584325e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:01.394530 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e7d47455-0254-4569-9d03-9b5ee584325e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1258 microversion: 2.1 time: 0.211752 Apr 12 00:30:01.395222 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 262/505] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:01 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1258 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:01.543945 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-88f8a63f-a84c-4364-a2f9-b99fb0409154 req-12a219b8-7276-48fc-84ed-9e3c7811ec82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b845b619-f58f-4bfd-9a48-df1b1c742def", "name": "network-vif-plugged", "status": "completed", "tag": "d9cbe626-bf12-4a6f-94c5-36e54b08b033"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:01.555318 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-88f8a63f-a84c-4364-a2f9-b99fb0409154 req-12a219b8-7276-48fc-84ed-9e3c7811ec82 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:01.555842 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-88f8a63f-a84c-4364-a2f9-b99fb0409154 req-12a219b8-7276-48fc-84ed-9e3c7811ec82 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:01.568036 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-88f8a63f-a84c-4364-a2f9-b99fb0409154 req-12a219b8-7276-48fc-84ed-9e3c7811ec82 service nova] Creating event network-vif-plugged:d9cbe626-bf12-4a6f-94c5-36e54b08b033 for instance b845b619-f58f-4bfd-9a48-df1b1c742def on hv-cinder-83625 Apr 12 00:30:01.573292 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-88f8a63f-a84c-4364-a2f9-b99fb0409154 req-12a219b8-7276-48fc-84ed-9e3c7811ec82 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033113 Apr 12 00:30:01.573890 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 244/506] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:01.728567 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1754d196-4a5f-440a-9484-2e2cf64a9dd3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:01.729428 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1754d196-4a5f-440a-9484-2e2cf64a9dd3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:01.735891 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1754d196-4a5f-440a-9484-2e2cf64a9dd3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:01.736273 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1754d196-4a5f-440a-9484-2e2cf64a9dd3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:01.737232 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1754d196-4a5f-440a-9484-2e2cf64a9dd3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:01.737658 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1754d196-4a5f-440a-9484-2e2cf64a9dd3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:01.895436 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1754d196-4a5f-440a-9484-2e2cf64a9dd3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:01.903165 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1754d196-4a5f-440a-9484-2e2cf64a9dd3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1319 microversion: 2.1 time: 0.178610 Apr 12 00:30:01.903825 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 263/507] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:01 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:02.306485 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-ae0eef42-e9e3-47f2-8f8f-923b2e829d3f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:02.307281 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-ae0eef42-e9e3-47f2-8f8f-923b2e829d3f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:02.320172 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ae0eef42-e9e3-47f2-8f8f-923b2e829d3f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:02.320636 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ae0eef42-e9e3-47f2-8f8f-923b2e829d3f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:02.321734 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ae0eef42-e9e3-47f2-8f8f-923b2e829d3f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:02.322747 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ae0eef42-e9e3-47f2-8f8f-923b2e829d3f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:02.413384 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a00edeb3-dda6-4a0e-9b13-543133737f00 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:02.414006 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a00edeb3-dda6-4a0e-9b13-543133737f00 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:02.423252 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a00edeb3-dda6-4a0e-9b13-543133737f00 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:02.424024 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a00edeb3-dda6-4a0e-9b13-543133737f00 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:02.425044 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a00edeb3-dda6-4a0e-9b13-543133737f00 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:02.426705 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a00edeb3-dda6-4a0e-9b13-543133737f00 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:02.492817 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ae0eef42-e9e3-47f2-8f8f-923b2e829d3f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:02.501942 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ae0eef42-e9e3-47f2-8f8f-923b2e829d3f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:02.503819 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ae0eef42-e9e3-47f2-8f8f-923b2e829d3f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:02.505045 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-ae0eef42-e9e3-47f2-8f8f-923b2e829d3f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1743 microversion: 2.20 time: 0.203682 Apr 12 00:30:02.505623 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 245/508] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:02 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1743 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:02.592563 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a00edeb3-dda6-4a0e-9b13-543133737f00 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:02.600492 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a00edeb3-dda6-4a0e-9b13-543133737f00 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1258 microversion: 2.1 time: 0.191659 Apr 12 00:30:02.602404 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 264/509] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:02 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1258 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:02.920456 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-db5c0557-35ec-4efc-b329-1b2093af2948 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:02.921032 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-db5c0557-35ec-4efc-b329-1b2093af2948 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:02.927057 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-db5c0557-35ec-4efc-b329-1b2093af2948 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:02.927510 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-db5c0557-35ec-4efc-b329-1b2093af2948 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:02.928315 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-db5c0557-35ec-4efc-b329-1b2093af2948 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:02.928755 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-db5c0557-35ec-4efc-b329-1b2093af2948 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:03.068586 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-db5c0557-35ec-4efc-b329-1b2093af2948 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:03.075867 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-db5c0557-35ec-4efc-b329-1b2093af2948 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1319 microversion: 2.1 time: 0.159495 Apr 12 00:30:03.076433 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 246/510] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:02 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:03.524372 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-dcf6170c-176e-4616-85bb-6448d566ea55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:03.524998 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-dcf6170c-176e-4616-85bb-6448d566ea55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:03.533114 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dcf6170c-176e-4616-85bb-6448d566ea55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:03.533557 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dcf6170c-176e-4616-85bb-6448d566ea55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:03.534351 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dcf6170c-176e-4616-85bb-6448d566ea55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:03.534787 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dcf6170c-176e-4616-85bb-6448d566ea55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:03.616790 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e28f03bc-371c-4f97-9063-df61c97f4319 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:03.617401 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e28f03bc-371c-4f97-9063-df61c97f4319 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:03.624128 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e28f03bc-371c-4f97-9063-df61c97f4319 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:03.624574 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e28f03bc-371c-4f97-9063-df61c97f4319 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:03.625341 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e28f03bc-371c-4f97-9063-df61c97f4319 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:03.625766 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e28f03bc-371c-4f97-9063-df61c97f4319 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:03.664259 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-dcf6170c-176e-4616-85bb-6448d566ea55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:03.679493 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-dcf6170c-176e-4616-85bb-6448d566ea55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:03.681071 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-dcf6170c-176e-4616-85bb-6448d566ea55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:03.682185 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-dcf6170c-176e-4616-85bb-6448d566ea55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1743 microversion: 2.20 time: 0.162105 Apr 12 00:30:03.682779 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 265/511] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:03 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:03.756462 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e28f03bc-371c-4f97-9063-df61c97f4319 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:03.763800 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e28f03bc-371c-4f97-9063-df61c97f4319 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1442 microversion: 2.1 time: 0.150774 Apr 12 00:30:03.764370 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 247/512] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:03 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1442 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:03.780685 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-d97463d5-f859-499b-b3fa-12ed5296b8dc tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:03.781303 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-d97463d5-f859-499b-b3fa-12ed5296b8dc tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:03.787861 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d97463d5-f859-499b-b3fa-12ed5296b8dc tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:03.788317 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d97463d5-f859-499b-b3fa-12ed5296b8dc tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:03.789097 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d97463d5-f859-499b-b3fa-12ed5296b8dc tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:03.789531 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d97463d5-f859-499b-b3fa-12ed5296b8dc tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:03.924284 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-d97463d5-f859-499b-b3fa-12ed5296b8dc tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:03.932653 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-d97463d5-f859-499b-b3fa-12ed5296b8dc tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1442 microversion: 2.1 time: 0.156097 Apr 12 00:30:03.933994 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 266/513] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:03 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:04.092920 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2d9388a0-6596-4dd5-b228-fe58911669aa tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:04.093530 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2d9388a0-6596-4dd5-b228-fe58911669aa tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:04.099350 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2d9388a0-6596-4dd5-b228-fe58911669aa tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:04.099796 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2d9388a0-6596-4dd5-b228-fe58911669aa tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:04.100552 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2d9388a0-6596-4dd5-b228-fe58911669aa tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:04.100980 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2d9388a0-6596-4dd5-b228-fe58911669aa tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:04.233539 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2d9388a0-6596-4dd5-b228-fe58911669aa tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:04.241090 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2d9388a0-6596-4dd5-b228-fe58911669aa tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1319 microversion: 2.1 time: 0.152395 Apr 12 00:30:04.241741 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 248/514] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:04 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:04.701107 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-66cbd15e-6550-4abe-ab2b-d8e58f430d86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:04.701811 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-66cbd15e-6550-4abe-ab2b-d8e58f430d86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:04.708509 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-66cbd15e-6550-4abe-ab2b-d8e58f430d86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:04.709044 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-66cbd15e-6550-4abe-ab2b-d8e58f430d86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:04.709889 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-66cbd15e-6550-4abe-ab2b-d8e58f430d86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:04.710498 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-66cbd15e-6550-4abe-ab2b-d8e58f430d86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:04.972105 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-66cbd15e-6550-4abe-ab2b-d8e58f430d86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:04.996256 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-a1dea757-1c84-43e4-a8fc-39deb166fb74 req-283bc5bf-6fa7-4e8f-89ab-48164cbef575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c4e615-6c86-41a2-b6a5-19371b76e311", "name": "network-vif-plugged", "status": "completed", "tag": "a96b86a8-a90d-426f-9b7e-b2dc136b138a"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:04.997193 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-66cbd15e-6550-4abe-ab2b-d8e58f430d86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:05.000701 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-66cbd15e-6550-4abe-ab2b-d8e58f430d86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:05.006158 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-66cbd15e-6550-4abe-ab2b-d8e58f430d86 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1743 microversion: 2.20 time: 0.309428 Apr 12 00:30:05.018163 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 267/515] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:04 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1743 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:05.022750 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-a1dea757-1c84-43e4-a8fc-39deb166fb74 req-283bc5bf-6fa7-4e8f-89ab-48164cbef575 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:05.023478 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-a1dea757-1c84-43e4-a8fc-39deb166fb74 req-283bc5bf-6fa7-4e8f-89ab-48164cbef575 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:05.036173 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-a1dea757-1c84-43e4-a8fc-39deb166fb74 req-283bc5bf-6fa7-4e8f-89ab-48164cbef575 service nova] Creating event network-vif-plugged:a96b86a8-a90d-426f-9b7e-b2dc136b138a for instance 02c4e615-6c86-41a2-b6a5-19371b76e311 on hv-cinder-83625 Apr 12 00:30:05.041722 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-a1dea757-1c84-43e4-a8fc-39deb166fb74 req-283bc5bf-6fa7-4e8f-89ab-48164cbef575 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049680 Apr 12 00:30:05.042583 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 249/516] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:30:05.258290 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4bfb9bad-a1ca-4c49-85d2-bced8c6dcb7e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:05.258290 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4bfb9bad-a1ca-4c49-85d2-bced8c6dcb7e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:05.265306 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4bfb9bad-a1ca-4c49-85d2-bced8c6dcb7e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:05.265854 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4bfb9bad-a1ca-4c49-85d2-bced8c6dcb7e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:05.266654 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4bfb9bad-a1ca-4c49-85d2-bced8c6dcb7e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:05.267281 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4bfb9bad-a1ca-4c49-85d2-bced8c6dcb7e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:05.489478 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4bfb9bad-a1ca-4c49-85d2-bced8c6dcb7e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:05.497326 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4bfb9bad-a1ca-4c49-85d2-bced8c6dcb7e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1507 microversion: 2.1 time: 0.243596 Apr 12 00:30:05.497967 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 268/517] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:05 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:05.514774 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-6b90327d-91ec-4fb1-8b02-98ebcccd55e1 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "680b735b-de32-4ac6-b061-cf52d7dc57d8", "device": "/dev/sdb"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:05.515948 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-6b90327d-91ec-4fb1-8b02-98ebcccd55e1 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:05.522627 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6b90327d-91ec-4fb1-8b02-98ebcccd55e1 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:05.523161 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6b90327d-91ec-4fb1-8b02-98ebcccd55e1 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:05.524096 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6b90327d-91ec-4fb1-8b02-98ebcccd55e1 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:05.524528 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6b90327d-91ec-4fb1-8b02-98ebcccd55e1 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:05.949342 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-6b90327d-91ec-4fb1-8b02-98ebcccd55e1 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "POST /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.438543 Apr 12 00:30:05.950437 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 250/518] 10.222.0.32 () {60 vars in 1322 bytes} [Tue Apr 12 00:30:05 2022] POST /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:30:06.031927 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-6ed9104a-e2ba-4054-a6a4-b268b827779f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:06.032599 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-6ed9104a-e2ba-4054-a6a4-b268b827779f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:06.045852 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6ed9104a-e2ba-4054-a6a4-b268b827779f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:06.046647 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6ed9104a-e2ba-4054-a6a4-b268b827779f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:06.047590 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6ed9104a-e2ba-4054-a6a4-b268b827779f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:06.048377 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6ed9104a-e2ba-4054-a6a4-b268b827779f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:06.127906 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-47580d13-89f5-4766-87fe-cd94cc6de3c1 req-9a86fc43-8b91-4e92-a0ea-b4bfc8fea842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29aa1426-1684-47b1-aded-1c9c306543bc", "tag": "94406837-92d7-472c-9764-43cc0c5b4cd8"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:06.140127 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-47580d13-89f5-4766-87fe-cd94cc6de3c1 req-9a86fc43-8b91-4e92-a0ea-b4bfc8fea842 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:06.141055 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-47580d13-89f5-4766-87fe-cd94cc6de3c1 req-9a86fc43-8b91-4e92-a0ea-b4bfc8fea842 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:06.161775 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-47580d13-89f5-4766-87fe-cd94cc6de3c1 req-9a86fc43-8b91-4e92-a0ea-b4bfc8fea842 service nova] Creating event network-changed:94406837-92d7-472c-9764-43cc0c5b4cd8 for instance 29aa1426-1684-47b1-aded-1c9c306543bc on hv-cinder-83625 Apr 12 00:30:06.169397 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-47580d13-89f5-4766-87fe-cd94cc6de3c1 req-9a86fc43-8b91-4e92-a0ea-b4bfc8fea842 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048300 Apr 12 00:30:06.170982 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 251/519] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:06.218918 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-6ed9104a-e2ba-4054-a6a4-b268b827779f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:06.226903 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-6ed9104a-e2ba-4054-a6a4-b268b827779f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:06.228459 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-6ed9104a-e2ba-4054-a6a4-b268b827779f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:06.229617 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-6ed9104a-e2ba-4054-a6a4-b268b827779f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.202663 Apr 12 00:30:06.230168 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 269/520] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:06 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:07.251341 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b4a23de8-362a-4c60-8cce-39d990f1c6e2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:07.252263 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b4a23de8-362a-4c60-8cce-39d990f1c6e2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:07.258770 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b4a23de8-362a-4c60-8cce-39d990f1c6e2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:07.259475 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b4a23de8-362a-4c60-8cce-39d990f1c6e2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:07.260458 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b4a23de8-362a-4c60-8cce-39d990f1c6e2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:07.261207 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b4a23de8-362a-4c60-8cce-39d990f1c6e2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:07.463671 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b4a23de8-362a-4c60-8cce-39d990f1c6e2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:07.479843 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b4a23de8-362a-4c60-8cce-39d990f1c6e2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:07.491394 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b4a23de8-362a-4c60-8cce-39d990f1c6e2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:07.493268 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b4a23de8-362a-4c60-8cce-39d990f1c6e2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.247777 Apr 12 00:30:07.494149 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 252/521] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:07 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:08.525868 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9bad716f-f8ff-4c6f-a62e-ff925a8d7e9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:08.527204 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9bad716f-f8ff-4c6f-a62e-ff925a8d7e9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:08.535923 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9bad716f-f8ff-4c6f-a62e-ff925a8d7e9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:08.537193 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9bad716f-f8ff-4c6f-a62e-ff925a8d7e9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:08.537968 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9bad716f-f8ff-4c6f-a62e-ff925a8d7e9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:08.538441 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9bad716f-f8ff-4c6f-a62e-ff925a8d7e9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:08.706456 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9bad716f-f8ff-4c6f-a62e-ff925a8d7e9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:08.715136 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9bad716f-f8ff-4c6f-a62e-ff925a8d7e9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:08.716817 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9bad716f-f8ff-4c6f-a62e-ff925a8d7e9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:08.719293 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9bad716f-f8ff-4c6f-a62e-ff925a8d7e9c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.209712 Apr 12 00:30:08.723850 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 270/522] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:08 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:09.740321 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-663d620a-dde7-4636-9938-42d1053b1839 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:09.741653 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-663d620a-dde7-4636-9938-42d1053b1839 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:09.749095 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-663d620a-dde7-4636-9938-42d1053b1839 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:09.749551 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-663d620a-dde7-4636-9938-42d1053b1839 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:09.750460 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-663d620a-dde7-4636-9938-42d1053b1839 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:09.751199 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-663d620a-dde7-4636-9938-42d1053b1839 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:09.793806 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-45061feb-852e-4201-bf5d-277bfd2b9eb8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:09.794419 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-45061feb-852e-4201-bf5d-277bfd2b9eb8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:09.800909 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-45061feb-852e-4201-bf5d-277bfd2b9eb8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:09.801640 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-45061feb-852e-4201-bf5d-277bfd2b9eb8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:09.804592 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-45061feb-852e-4201-bf5d-277bfd2b9eb8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:09.805301 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-45061feb-852e-4201-bf5d-277bfd2b9eb8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:09.842847 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-45061feb-852e-4201-bf5d-277bfd2b9eb8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/ips" status: 200 len: 146 microversion: 2.1 time: 0.052884 Apr 12 00:30:09.844096 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 271/523] 10.222.0.32 () {58 vars in 1247 bytes} [Tue Apr 12 00:30:09 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/ips => generated 146 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:09.913751 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-663d620a-dde7-4636-9938-42d1053b1839 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:09.925660 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-663d620a-dde7-4636-9938-42d1053b1839 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:09.927537 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-663d620a-dde7-4636-9938-42d1053b1839 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:09.928903 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-663d620a-dde7-4636-9938-42d1053b1839 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.192613 Apr 12 00:30:09.929765 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 253/524] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:09 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:10.948068 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9fd874d5-edc7-4f18-8174-45fa6d66a948 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:10.949974 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9fd874d5-edc7-4f18-8174-45fa6d66a948 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:10.956252 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9fd874d5-edc7-4f18-8174-45fa6d66a948 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:10.956704 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9fd874d5-edc7-4f18-8174-45fa6d66a948 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:10.957465 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9fd874d5-edc7-4f18-8174-45fa6d66a948 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:10.958181 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9fd874d5-edc7-4f18-8174-45fa6d66a948 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:11.113330 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9fd874d5-edc7-4f18-8174-45fa6d66a948 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:11.122725 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9fd874d5-edc7-4f18-8174-45fa6d66a948 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:11.124237 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9fd874d5-edc7-4f18-8174-45fa6d66a948 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:11.125903 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9fd874d5-edc7-4f18-8174-45fa6d66a948 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.181736 Apr 12 00:30:11.126574 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 272/525] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:10 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:12.144156 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2a46b6d3-dc15-4c42-afd0-5d560f8efee8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:12.144901 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2a46b6d3-dc15-4c42-afd0-5d560f8efee8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:12.153060 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2a46b6d3-dc15-4c42-afd0-5d560f8efee8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:12.153518 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2a46b6d3-dc15-4c42-afd0-5d560f8efee8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:12.154330 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2a46b6d3-dc15-4c42-afd0-5d560f8efee8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:12.154983 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2a46b6d3-dc15-4c42-afd0-5d560f8efee8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:12.307753 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2a46b6d3-dc15-4c42-afd0-5d560f8efee8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:12.319762 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2a46b6d3-dc15-4c42-afd0-5d560f8efee8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:12.321553 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2a46b6d3-dc15-4c42-afd0-5d560f8efee8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:12.323048 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2a46b6d3-dc15-4c42-afd0-5d560f8efee8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.183105 Apr 12 00:30:12.330293 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 254/526] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:12 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:12.553546 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7c206348-adf8-4547-9d43-94417437d55b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f52328bb-551f-445c-b22e-04eef6a2e067"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:12.554921 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7c206348-adf8-4547-9d43-94417437d55b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:12.562368 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7c206348-adf8-4547-9d43-94417437d55b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:12.563080 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7c206348-adf8-4547-9d43-94417437d55b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:12.563925 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7c206348-adf8-4547-9d43-94417437d55b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:12.564383 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7c206348-adf8-4547-9d43-94417437d55b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:13.341671 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-afca0e48-834c-45b1-9e96-5d22bb14d37f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:13.342223 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-afca0e48-834c-45b1-9e96-5d22bb14d37f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:13.348995 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-afca0e48-834c-45b1-9e96-5d22bb14d37f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:13.349740 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-afca0e48-834c-45b1-9e96-5d22bb14d37f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:13.350628 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-afca0e48-834c-45b1-9e96-5d22bb14d37f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:13.351234 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-afca0e48-834c-45b1-9e96-5d22bb14d37f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:13.506715 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-afca0e48-834c-45b1-9e96-5d22bb14d37f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:13.519871 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-afca0e48-834c-45b1-9e96-5d22bb14d37f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:13.521791 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-afca0e48-834c-45b1-9e96-5d22bb14d37f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:13.523323 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-afca0e48-834c-45b1-9e96-5d22bb14d37f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.186376 Apr 12 00:30:13.532923 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 255/527] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:13 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:30:13.644187 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7c206348-adf8-4547-9d43-94417437d55b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "POST /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.094452 Apr 12 00:30:13.645848 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 273/528] 10.222.0.32 () {60 vars in 1322 bytes} [Tue Apr 12 00:30:12 2022] POST /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/os-volume_attachments => generated 194 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:14.550601 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b3351dba-eefb-4de1-9ada-13429bd8b5ce tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:14.551768 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b3351dba-eefb-4de1-9ada-13429bd8b5ce tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:14.558332 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b3351dba-eefb-4de1-9ada-13429bd8b5ce tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:14.561875 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b3351dba-eefb-4de1-9ada-13429bd8b5ce tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:14.562891 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b3351dba-eefb-4de1-9ada-13429bd8b5ce tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:14.563490 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b3351dba-eefb-4de1-9ada-13429bd8b5ce tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:14.739602 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b3351dba-eefb-4de1-9ada-13429bd8b5ce tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:14.750309 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b3351dba-eefb-4de1-9ada-13429bd8b5ce tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:14.752253 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b3351dba-eefb-4de1-9ada-13429bd8b5ce tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:14.753752 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b3351dba-eefb-4de1-9ada-13429bd8b5ce tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.206849 Apr 12 00:30:14.754689 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 256/529] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:14 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:15.773939 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-48f48d98-6780-412d-8294-694b7c0ffc74 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:15.775012 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-48f48d98-6780-412d-8294-694b7c0ffc74 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:15.783253 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48f48d98-6780-412d-8294-694b7c0ffc74 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:15.783704 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48f48d98-6780-412d-8294-694b7c0ffc74 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:15.784473 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48f48d98-6780-412d-8294-694b7c0ffc74 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:15.784905 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48f48d98-6780-412d-8294-694b7c0ffc74 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:15.958651 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-48f48d98-6780-412d-8294-694b7c0ffc74 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:15.970308 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-48f48d98-6780-412d-8294-694b7c0ffc74 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:15.973347 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-48f48d98-6780-412d-8294-694b7c0ffc74 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:15.974935 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-48f48d98-6780-412d-8294-694b7c0ffc74 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.206276 Apr 12 00:30:15.976015 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 274/530] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:15 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:16.993006 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-6cb28cb6-de08-41cc-b417-4b043a4863fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:16.993638 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-6cb28cb6-de08-41cc-b417-4b043a4863fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:16.999921 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6cb28cb6-de08-41cc-b417-4b043a4863fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:17.000360 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6cb28cb6-de08-41cc-b417-4b043a4863fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:17.001108 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6cb28cb6-de08-41cc-b417-4b043a4863fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:17.001532 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6cb28cb6-de08-41cc-b417-4b043a4863fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:17.125618 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-6cb28cb6-de08-41cc-b417-4b043a4863fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:17.133233 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-6cb28cb6-de08-41cc-b417-4b043a4863fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:17.134757 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-6cb28cb6-de08-41cc-b417-4b043a4863fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:17.135886 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-6cb28cb6-de08-41cc-b417-4b043a4863fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.146716 Apr 12 00:30:17.137052 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 257/531] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:16 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:18.155109 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5a4c62a1-0e51-4935-9afa-46df9ec32e16 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:18.155714 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5a4c62a1-0e51-4935-9afa-46df9ec32e16 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:18.161914 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5a4c62a1-0e51-4935-9afa-46df9ec32e16 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:18.162395 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5a4c62a1-0e51-4935-9afa-46df9ec32e16 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:18.163161 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5a4c62a1-0e51-4935-9afa-46df9ec32e16 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:18.163596 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5a4c62a1-0e51-4935-9afa-46df9ec32e16 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:18.289423 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5a4c62a1-0e51-4935-9afa-46df9ec32e16 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:18.297025 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5a4c62a1-0e51-4935-9afa-46df9ec32e16 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:18.298552 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5a4c62a1-0e51-4935-9afa-46df9ec32e16 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:18.299697 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5a4c62a1-0e51-4935-9afa-46df9ec32e16 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.148959 Apr 12 00:30:18.300260 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 275/532] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:18 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:19.317004 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e6ccf19a-bdd7-47fd-9d6e-ec4ade844290 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:19.317548 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e6ccf19a-bdd7-47fd-9d6e-ec4ade844290 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:19.323773 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e6ccf19a-bdd7-47fd-9d6e-ec4ade844290 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:19.324224 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e6ccf19a-bdd7-47fd-9d6e-ec4ade844290 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:19.324984 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e6ccf19a-bdd7-47fd-9d6e-ec4ade844290 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:19.325418 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e6ccf19a-bdd7-47fd-9d6e-ec4ade844290 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:19.448909 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e6ccf19a-bdd7-47fd-9d6e-ec4ade844290 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:19.456547 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e6ccf19a-bdd7-47fd-9d6e-ec4ade844290 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:19.458030 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e6ccf19a-bdd7-47fd-9d6e-ec4ade844290 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:19.459198 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e6ccf19a-bdd7-47fd-9d6e-ec4ade844290 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.146159 Apr 12 00:30:19.459753 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 258/533] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:19 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:20.478018 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-77b0f6cf-04a1-4cb0-b530-3612734a7197 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:20.478655 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-77b0f6cf-04a1-4cb0-b530-3612734a7197 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:20.485496 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-77b0f6cf-04a1-4cb0-b530-3612734a7197 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:20.485946 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-77b0f6cf-04a1-4cb0-b530-3612734a7197 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:20.486730 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-77b0f6cf-04a1-4cb0-b530-3612734a7197 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:20.487175 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-77b0f6cf-04a1-4cb0-b530-3612734a7197 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:20.608797 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-77b0f6cf-04a1-4cb0-b530-3612734a7197 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:20.616394 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-77b0f6cf-04a1-4cb0-b530-3612734a7197 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:20.617889 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-77b0f6cf-04a1-4cb0-b530-3612734a7197 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:20.619082 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-77b0f6cf-04a1-4cb0-b530-3612734a7197 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.144956 Apr 12 00:30:20.619646 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 276/534] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:20 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:21.636632 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b96c28ef-4de3-4f21-b90d-ec6afedcb5ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:21.637238 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b96c28ef-4de3-4f21-b90d-ec6afedcb5ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:21.643531 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b96c28ef-4de3-4f21-b90d-ec6afedcb5ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:21.643971 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b96c28ef-4de3-4f21-b90d-ec6afedcb5ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:21.644714 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b96c28ef-4de3-4f21-b90d-ec6afedcb5ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:21.645140 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b96c28ef-4de3-4f21-b90d-ec6afedcb5ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:21.774150 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b96c28ef-4de3-4f21-b90d-ec6afedcb5ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:21.782558 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b96c28ef-4de3-4f21-b90d-ec6afedcb5ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:21.784256 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b96c28ef-4de3-4f21-b90d-ec6afedcb5ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:21.785494 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b96c28ef-4de3-4f21-b90d-ec6afedcb5ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.152679 Apr 12 00:30:21.786071 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 259/535] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:21 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:22.804290 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-87ae999d-fd9f-4ef8-a51c-1a150fb20d48 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:22.804903 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-87ae999d-fd9f-4ef8-a51c-1a150fb20d48 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:22.811703 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-87ae999d-fd9f-4ef8-a51c-1a150fb20d48 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:22.812155 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-87ae999d-fd9f-4ef8-a51c-1a150fb20d48 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:22.812917 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-87ae999d-fd9f-4ef8-a51c-1a150fb20d48 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:22.813357 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-87ae999d-fd9f-4ef8-a51c-1a150fb20d48 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:22.935800 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-87ae999d-fd9f-4ef8-a51c-1a150fb20d48 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:22.943486 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-87ae999d-fd9f-4ef8-a51c-1a150fb20d48 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:22.944984 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-87ae999d-fd9f-4ef8-a51c-1a150fb20d48 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:22.946117 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-87ae999d-fd9f-4ef8-a51c-1a150fb20d48 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.145740 Apr 12 00:30:22.946713 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 277/536] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:22 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:23.964822 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-91e67ac2-4c66-4d3d-8a7a-af31de6a9bc3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:23.965516 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-91e67ac2-4c66-4d3d-8a7a-af31de6a9bc3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:23.971656 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-91e67ac2-4c66-4d3d-8a7a-af31de6a9bc3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:23.972098 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-91e67ac2-4c66-4d3d-8a7a-af31de6a9bc3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:23.972842 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-91e67ac2-4c66-4d3d-8a7a-af31de6a9bc3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:23.973270 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-91e67ac2-4c66-4d3d-8a7a-af31de6a9bc3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:24.097654 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-91e67ac2-4c66-4d3d-8a7a-af31de6a9bc3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:24.106939 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-91e67ac2-4c66-4d3d-8a7a-af31de6a9bc3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:24.108434 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-91e67ac2-4c66-4d3d-8a7a-af31de6a9bc3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:24.109579 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-91e67ac2-4c66-4d3d-8a7a-af31de6a9bc3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.149142 Apr 12 00:30:24.110125 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 260/537] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:23 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:25.127635 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-394df23a-9675-4668-a5ae-6854585399c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:25.128252 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-394df23a-9675-4668-a5ae-6854585399c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:25.134505 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-394df23a-9675-4668-a5ae-6854585399c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:25.134950 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-394df23a-9675-4668-a5ae-6854585399c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:25.135712 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-394df23a-9675-4668-a5ae-6854585399c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:25.136637 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-394df23a-9675-4668-a5ae-6854585399c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:25.265892 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-394df23a-9675-4668-a5ae-6854585399c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:25.273693 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-394df23a-9675-4668-a5ae-6854585399c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:25.275211 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-394df23a-9675-4668-a5ae-6854585399c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:25.276339 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-394df23a-9675-4668-a5ae-6854585399c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.152657 Apr 12 00:30:25.276968 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 278/538] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:25 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:26.297144 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a343f2c5-1c73-4503-8587-609c05afc8e6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:26.298017 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a343f2c5-1c73-4503-8587-609c05afc8e6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:26.304802 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a343f2c5-1c73-4503-8587-609c05afc8e6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:26.305256 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a343f2c5-1c73-4503-8587-609c05afc8e6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:26.306701 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a343f2c5-1c73-4503-8587-609c05afc8e6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:26.307305 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a343f2c5-1c73-4503-8587-609c05afc8e6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:26.439914 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a343f2c5-1c73-4503-8587-609c05afc8e6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:26.447722 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a343f2c5-1c73-4503-8587-609c05afc8e6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:26.449869 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a343f2c5-1c73-4503-8587-609c05afc8e6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:26.451056 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a343f2c5-1c73-4503-8587-609c05afc8e6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1738 microversion: 2.20 time: 0.160207 Apr 12 00:30:26.451610 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 261/539] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:26 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:27.469485 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7032df95-1a3c-4b8d-aea3-6e349d04b2bf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:27.470353 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7032df95-1a3c-4b8d-aea3-6e349d04b2bf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:27.476628 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7032df95-1a3c-4b8d-aea3-6e349d04b2bf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:27.477084 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7032df95-1a3c-4b8d-aea3-6e349d04b2bf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:27.477995 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7032df95-1a3c-4b8d-aea3-6e349d04b2bf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:27.478310 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7032df95-1a3c-4b8d-aea3-6e349d04b2bf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:27.559262 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-ed31c6fd-905a-4d2f-bc45-7e8f65aa142c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:27.565683 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ed31c6fd-905a-4d2f-bc45-7e8f65aa142c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:27.566073 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ed31c6fd-905a-4d2f-bc45-7e8f65aa142c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:27.608385 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7032df95-1a3c-4b8d-aea3-6e349d04b2bf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:27.616195 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7032df95-1a3c-4b8d-aea3-6e349d04b2bf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:27.617695 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7032df95-1a3c-4b8d-aea3-6e349d04b2bf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:27.618860 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7032df95-1a3c-4b8d-aea3-6e349d04b2bf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1720 microversion: 2.20 time: 0.153270 Apr 12 00:30:27.619427 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 279/540] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:27 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:27.625111 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-ed31c6fd-905a-4d2f-bc45-7e8f65aa142c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Going to try to stop instance {{(pid=128487) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 12 00:30:27.669262 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-ed31c6fd-905a-4d2f-bc45-7e8f65aa142c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "POST /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/action" status: 202 len: 0 microversion: 2.1 time: 0.113575 Apr 12 00:30:27.669701 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 262/541] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Apr 12 00:30:27 2022] POST /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 00:30:27.677572 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-bc6e9630-1d7f-4d14-8a92-f6bb3d79a13c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:27.678183 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-bc6e9630-1d7f-4d14-8a92-f6bb3d79a13c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:27.684584 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bc6e9630-1d7f-4d14-8a92-f6bb3d79a13c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:27.685031 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bc6e9630-1d7f-4d14-8a92-f6bb3d79a13c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:27.685792 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bc6e9630-1d7f-4d14-8a92-f6bb3d79a13c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:27.686225 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bc6e9630-1d7f-4d14-8a92-f6bb3d79a13c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:27.814803 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-bc6e9630-1d7f-4d14-8a92-f6bb3d79a13c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:27.822845 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-bc6e9630-1d7f-4d14-8a92-f6bb3d79a13c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.148968 Apr 12 00:30:27.823990 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 280/542] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:27 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:28.638619 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-ae611304-ee85-41f4-84ab-b111b3c9717f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:28.639270 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-ae611304-ee85-41f4-84ab-b111b3c9717f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:28.645117 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ae611304-ee85-41f4-84ab-b111b3c9717f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:28.645556 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ae611304-ee85-41f4-84ab-b111b3c9717f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:28.646590 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ae611304-ee85-41f4-84ab-b111b3c9717f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:28.647018 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ae611304-ee85-41f4-84ab-b111b3c9717f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:28.771239 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ae611304-ee85-41f4-84ab-b111b3c9717f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:28.780302 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ae611304-ee85-41f4-84ab-b111b3c9717f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:28.781785 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ae611304-ee85-41f4-84ab-b111b3c9717f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:28.782948 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-ae611304-ee85-41f4-84ab-b111b3c9717f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1720 microversion: 2.20 time: 0.149024 Apr 12 00:30:28.783499 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 263/543] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:28 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:28.841214 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e0180b4b-328e-4f75-a087-90b661590fda tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:28.841820 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e0180b4b-328e-4f75-a087-90b661590fda tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:28.848073 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e0180b4b-328e-4f75-a087-90b661590fda tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:28.848520 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e0180b4b-328e-4f75-a087-90b661590fda tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:28.849279 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e0180b4b-328e-4f75-a087-90b661590fda tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:28.849718 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e0180b4b-328e-4f75-a087-90b661590fda tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:28.973073 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e0180b4b-328e-4f75-a087-90b661590fda tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:28.980748 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e0180b4b-328e-4f75-a087-90b661590fda tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.144047 Apr 12 00:30:28.981317 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 281/544] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:28 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:29.800851 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-41c8bea8-4eb1-467c-8a29-34f8c94b4582 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:29.801462 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-41c8bea8-4eb1-467c-8a29-34f8c94b4582 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:29.807677 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-41c8bea8-4eb1-467c-8a29-34f8c94b4582 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:29.808126 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-41c8bea8-4eb1-467c-8a29-34f8c94b4582 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:29.808884 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-41c8bea8-4eb1-467c-8a29-34f8c94b4582 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:29.809321 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-41c8bea8-4eb1-467c-8a29-34f8c94b4582 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:29.935297 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-41c8bea8-4eb1-467c-8a29-34f8c94b4582 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:29.943127 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-41c8bea8-4eb1-467c-8a29-34f8c94b4582 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:29.944713 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-41c8bea8-4eb1-467c-8a29-34f8c94b4582 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:29.945896 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-41c8bea8-4eb1-467c-8a29-34f8c94b4582 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1720 microversion: 2.20 time: 0.148932 Apr 12 00:30:29.946570 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 264/545] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:29 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:29.997311 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e0440ffa-1a97-4d2b-b73e-e1d253457401 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:29.997933 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e0440ffa-1a97-4d2b-b73e-e1d253457401 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:30.004195 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e0440ffa-1a97-4d2b-b73e-e1d253457401 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:30.004643 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e0440ffa-1a97-4d2b-b73e-e1d253457401 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:30.005424 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e0440ffa-1a97-4d2b-b73e-e1d253457401 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:30.005856 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e0440ffa-1a97-4d2b-b73e-e1d253457401 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:30.137748 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e0440ffa-1a97-4d2b-b73e-e1d253457401 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:30.145474 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e0440ffa-1a97-4d2b-b73e-e1d253457401 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.151955 Apr 12 00:30:30.146314 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 282/546] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:29 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:30.665626 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-b3a64a13-225b-47d0-b39b-6ef203c300f1 req-c04ba0fc-1bc5-45e4-9a66-d018e093b79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c4e615-6c86-41a2-b6a5-19371b76e311", "name": "network-vif-unplugged", "status": "completed", "tag": "a96b86a8-a90d-426f-9b7e-b2dc136b138a"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:30.675336 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-b3a64a13-225b-47d0-b39b-6ef203c300f1 req-c04ba0fc-1bc5-45e4-9a66-d018e093b79a service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:30.675785 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-b3a64a13-225b-47d0-b39b-6ef203c300f1 req-c04ba0fc-1bc5-45e4-9a66-d018e093b79a service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:30.686895 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-b3a64a13-225b-47d0-b39b-6ef203c300f1 req-c04ba0fc-1bc5-45e4-9a66-d018e093b79a service nova] Creating event network-vif-unplugged:a96b86a8-a90d-426f-9b7e-b2dc136b138a for instance 02c4e615-6c86-41a2-b6a5-19371b76e311 on hv-cinder-83625 Apr 12 00:30:30.691755 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-b3a64a13-225b-47d0-b39b-6ef203c300f1 req-c04ba0fc-1bc5-45e4-9a66-d018e093b79a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031991 Apr 12 00:30:30.692334 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 265/547] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:30.964205 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-24d2ae46-370b-44b3-b166-05b68b2c6c79 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:30.964808 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-24d2ae46-370b-44b3-b166-05b68b2c6c79 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:30.970741 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-24d2ae46-370b-44b3-b166-05b68b2c6c79 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:30.971186 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-24d2ae46-370b-44b3-b166-05b68b2c6c79 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:30.971941 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-24d2ae46-370b-44b3-b166-05b68b2c6c79 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:30.972368 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-24d2ae46-370b-44b3-b166-05b68b2c6c79 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:31.095358 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-24d2ae46-370b-44b3-b166-05b68b2c6c79 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:31.103069 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-24d2ae46-370b-44b3-b166-05b68b2c6c79 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:31.105076 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-24d2ae46-370b-44b3-b166-05b68b2c6c79 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:31.106259 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-24d2ae46-370b-44b3-b166-05b68b2c6c79 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1720 microversion: 2.20 time: 0.146059 Apr 12 00:30:31.106843 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 283/548] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:30 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1720 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:31.163772 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-0f3ccd71-7f2b-4569-a536-8f275a2e2e8f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:31.164452 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-0f3ccd71-7f2b-4569-a536-8f275a2e2e8f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:31.171464 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0f3ccd71-7f2b-4569-a536-8f275a2e2e8f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:31.171903 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0f3ccd71-7f2b-4569-a536-8f275a2e2e8f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:31.172653 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0f3ccd71-7f2b-4569-a536-8f275a2e2e8f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:31.173080 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0f3ccd71-7f2b-4569-a536-8f275a2e2e8f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:31.297562 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-0f3ccd71-7f2b-4569-a536-8f275a2e2e8f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:31.305327 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-0f3ccd71-7f2b-4569-a536-8f275a2e2e8f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.145697 Apr 12 00:30:31.305888 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 266/549] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:31 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:32.124476 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-06df5dca-30cf-4da0-ba2d-d6ae9cfb510b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:32.125065 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-06df5dca-30cf-4da0-ba2d-d6ae9cfb510b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:32.131111 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-06df5dca-30cf-4da0-ba2d-d6ae9cfb510b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:32.131562 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-06df5dca-30cf-4da0-ba2d-d6ae9cfb510b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:32.132326 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-06df5dca-30cf-4da0-ba2d-d6ae9cfb510b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:32.132762 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-06df5dca-30cf-4da0-ba2d-d6ae9cfb510b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:32.256870 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-06df5dca-30cf-4da0-ba2d-d6ae9cfb510b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:32.264692 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-06df5dca-30cf-4da0-ba2d-d6ae9cfb510b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:32.266177 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-06df5dca-30cf-4da0-ba2d-d6ae9cfb510b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:32.267341 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-06df5dca-30cf-4da0-ba2d-d6ae9cfb510b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1720 microversion: 2.20 time: 0.147754 Apr 12 00:30:32.267891 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 284/550] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:32 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:32.322911 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-752e2e45-9762-47f3-8070-57d76b8600f2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:32.323604 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-752e2e45-9762-47f3-8070-57d76b8600f2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:32.329880 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-752e2e45-9762-47f3-8070-57d76b8600f2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:32.330347 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-752e2e45-9762-47f3-8070-57d76b8600f2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:32.331100 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-752e2e45-9762-47f3-8070-57d76b8600f2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:32.331525 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-752e2e45-9762-47f3-8070-57d76b8600f2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:32.453296 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-752e2e45-9762-47f3-8070-57d76b8600f2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:32.461060 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-752e2e45-9762-47f3-8070-57d76b8600f2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.142029 Apr 12 00:30:32.461625 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 267/551] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:32 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:33.286231 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-62fabb83-9328-4e4c-ad82-08ab77f79c4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:33.286860 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-62fabb83-9328-4e4c-ad82-08ab77f79c4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:33.293109 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-62fabb83-9328-4e4c-ad82-08ab77f79c4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:33.293551 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-62fabb83-9328-4e4c-ad82-08ab77f79c4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:33.294327 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-62fabb83-9328-4e4c-ad82-08ab77f79c4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:33.294761 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-62fabb83-9328-4e4c-ad82-08ab77f79c4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:33.426183 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-62fabb83-9328-4e4c-ad82-08ab77f79c4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:33.433947 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-62fabb83-9328-4e4c-ad82-08ab77f79c4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:33.435467 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-62fabb83-9328-4e4c-ad82-08ab77f79c4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:33.436603 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-62fabb83-9328-4e4c-ad82-08ab77f79c4b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1720 microversion: 2.20 time: 0.154276 Apr 12 00:30:33.437156 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 285/552] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:33 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:33.478084 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-efba2003-7deb-4ce1-ae93-a42d8b2054fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:33.478965 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-efba2003-7deb-4ce1-ae93-a42d8b2054fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:33.484999 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-efba2003-7deb-4ce1-ae93-a42d8b2054fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:33.485449 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-efba2003-7deb-4ce1-ae93-a42d8b2054fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:33.486217 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-efba2003-7deb-4ce1-ae93-a42d8b2054fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:33.486690 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-efba2003-7deb-4ce1-ae93-a42d8b2054fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:33.618438 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-efba2003-7deb-4ce1-ae93-a42d8b2054fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:33.626604 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-efba2003-7deb-4ce1-ae93-a42d8b2054fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.152443 Apr 12 00:30:33.627177 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 268/553] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:33 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:34.455091 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5d69658c-b6da-4d2a-8140-f48f1a9f4ffe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:34.455702 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5d69658c-b6da-4d2a-8140-f48f1a9f4ffe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:34.462045 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5d69658c-b6da-4d2a-8140-f48f1a9f4ffe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:34.462524 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5d69658c-b6da-4d2a-8140-f48f1a9f4ffe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:34.463289 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5d69658c-b6da-4d2a-8140-f48f1a9f4ffe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:34.463903 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5d69658c-b6da-4d2a-8140-f48f1a9f4ffe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:34.586314 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5d69658c-b6da-4d2a-8140-f48f1a9f4ffe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:34.594946 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5d69658c-b6da-4d2a-8140-f48f1a9f4ffe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:34.596469 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5d69658c-b6da-4d2a-8140-f48f1a9f4ffe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:34.597614 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5d69658c-b6da-4d2a-8140-f48f1a9f4ffe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1720 microversion: 2.20 time: 0.146406 Apr 12 00:30:34.598168 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 286/554] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:34 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:34.644727 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-22bd1e37-7d72-45a5-843f-991cce2120e8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:34.645410 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-22bd1e37-7d72-45a5-843f-991cce2120e8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:34.652761 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-22bd1e37-7d72-45a5-843f-991cce2120e8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:34.653282 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-22bd1e37-7d72-45a5-843f-991cce2120e8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:34.654123 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-22bd1e37-7d72-45a5-843f-991cce2120e8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:34.659050 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-22bd1e37-7d72-45a5-843f-991cce2120e8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:34.783696 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-22bd1e37-7d72-45a5-843f-991cce2120e8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:34.791388 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-22bd1e37-7d72-45a5-843f-991cce2120e8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.151231 Apr 12 00:30:34.791957 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 269/555] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:34 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:35.616287 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2a2667e9-c9d9-4e6d-a6ef-fa8960924f95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:35.616916 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-2a2667e9-c9d9-4e6d-a6ef-fa8960924f95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:35.623707 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2a2667e9-c9d9-4e6d-a6ef-fa8960924f95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:35.624152 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2a2667e9-c9d9-4e6d-a6ef-fa8960924f95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:35.624905 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2a2667e9-c9d9-4e6d-a6ef-fa8960924f95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:35.625334 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2a2667e9-c9d9-4e6d-a6ef-fa8960924f95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:35.763685 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2a2667e9-c9d9-4e6d-a6ef-fa8960924f95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:35.773482 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2a2667e9-c9d9-4e6d-a6ef-fa8960924f95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:35.774425 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2a2667e9-c9d9-4e6d-a6ef-fa8960924f95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:35.775577 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2a2667e9-c9d9-4e6d-a6ef-fa8960924f95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1723 microversion: 2.20 time: 0.163149 Apr 12 00:30:35.776160 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 287/556] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:35 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:35.793497 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-0b042238-60fb-4de2-92f5-20c368fc18c8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9cdccdd-9093-4176-82f4-dcc3c57a1461"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:35.794637 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-0b042238-60fb-4de2-92f5-20c368fc18c8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:35.800870 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b042238-60fb-4de2-92f5-20c368fc18c8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:35.801323 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b042238-60fb-4de2-92f5-20c368fc18c8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:35.802117 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b042238-60fb-4de2-92f5-20c368fc18c8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:35.802656 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b042238-60fb-4de2-92f5-20c368fc18c8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:35.808852 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0ef87882-65a0-4c62-8f2a-415832445779 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:35.809587 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0ef87882-65a0-4c62-8f2a-415832445779 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:35.815460 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0ef87882-65a0-4c62-8f2a-415832445779 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:35.815908 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0ef87882-65a0-4c62-8f2a-415832445779 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:35.816663 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0ef87882-65a0-4c62-8f2a-415832445779 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:35.817093 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0ef87882-65a0-4c62-8f2a-415832445779 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:35.949065 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0ef87882-65a0-4c62-8f2a-415832445779 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:35.956767 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0ef87882-65a0-4c62-8f2a-415832445779 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.152260 Apr 12 00:30:35.957333 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 288/557] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:35 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:36.076458 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-0b042238-60fb-4de2-92f5-20c368fc18c8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "POST /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.287323 Apr 12 00:30:36.077054 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 270/558] 10.222.0.32 () {62 vars in 1363 bytes} [Tue Apr 12 00:30:35 2022] POST /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/os-volume_attachments => generated 188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:30:36.186874 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-68dbc04a-0c4d-4ccb-acde-72cced48f510 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:36.187434 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-68dbc04a-0c4d-4ccb-acde-72cced48f510 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:36.193122 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-68dbc04a-0c4d-4ccb-acde-72cced48f510 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:36.193569 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-68dbc04a-0c4d-4ccb-acde-72cced48f510 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:36.194345 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-68dbc04a-0c4d-4ccb-acde-72cced48f510 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:36.194781 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-68dbc04a-0c4d-4ccb-acde-72cced48f510 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:36.282517 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-68dbc04a-0c4d-4ccb-acde-72cced48f510 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "POST /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/action" status: 202 len: 0 microversion: 2.20 time: 0.099338 Apr 12 00:30:36.283129 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 289/559] 10.222.0.32 () {62 vars in 1318 bytes} [Tue Apr 12 00:30:36 2022] POST /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:30:36.291077 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-65aa14f0-a841-490c-a101-7a4bad673408 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:36.291755 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-65aa14f0-a841-490c-a101-7a4bad673408 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:36.298021 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-65aa14f0-a841-490c-a101-7a4bad673408 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:36.298692 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-65aa14f0-a841-490c-a101-7a4bad673408 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:36.299641 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-65aa14f0-a841-490c-a101-7a4bad673408 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:36.300075 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-65aa14f0-a841-490c-a101-7a4bad673408 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:36.425985 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-65aa14f0-a841-490c-a101-7a4bad673408 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:36.434149 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-65aa14f0-a841-490c-a101-7a4bad673408 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:36.435655 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-65aa14f0-a841-490c-a101-7a4bad673408 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:36.436789 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-65aa14f0-a841-490c-a101-7a4bad673408 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1749 microversion: 2.20 time: 0.149584 Apr 12 00:30:36.437341 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 271/560] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:36 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1749 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:30:36.799508 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-27b89042-06fc-4a5a-b585-39d8d6887f39 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:36.799991 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-27b89042-06fc-4a5a-b585-39d8d6887f39 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:36.805841 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-27b89042-06fc-4a5a-b585-39d8d6887f39 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:36.806351 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-27b89042-06fc-4a5a-b585-39d8d6887f39 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:36.807664 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-27b89042-06fc-4a5a-b585-39d8d6887f39 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:36.808125 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-27b89042-06fc-4a5a-b585-39d8d6887f39 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:36.886837 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-27b89042-06fc-4a5a-b585-39d8d6887f39 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lazy-loading 'services' on Instance uuid b845b619-f58f-4bfd-9a48-df1b1c742def {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:30:36.974873 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-290ef642-4772-4bdf-ae7c-ac9ee2ba1bd5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:36.975728 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-290ef642-4772-4bdf-ae7c-ac9ee2ba1bd5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:36.980483 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-27b89042-06fc-4a5a-b585-39d8d6887f39 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def/os-volume_attachments/680b735b-de32-4ac6-b061-cf52d7dc57d8" status: 202 len: 0 microversion: 2.1 time: 0.185084 Apr 12 00:30:36.983848 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-290ef642-4772-4bdf-ae7c-ac9ee2ba1bd5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:36.984555 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 290/561] 10.222.0.32 () {58 vars in 1415 bytes} [Tue Apr 12 00:30:36 2022] DELETE /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def/os-volume_attachments/680b735b-de32-4ac6-b061-cf52d7dc57d8 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:30:36.985214 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-290ef642-4772-4bdf-ae7c-ac9ee2ba1bd5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:36.985948 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-290ef642-4772-4bdf-ae7c-ac9ee2ba1bd5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:36.986404 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-290ef642-4772-4bdf-ae7c-ac9ee2ba1bd5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:37.124474 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-290ef642-4772-4bdf-ae7c-ac9ee2ba1bd5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:37.132272 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-290ef642-4772-4bdf-ae7c-ac9ee2ba1bd5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.161566 Apr 12 00:30:37.132772 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 272/562] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:36 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:37.455645 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-508e6355-e067-447a-a4e4-0acc521f6201 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:37.456334 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-508e6355-e067-447a-a4e4-0acc521f6201 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:37.462427 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-508e6355-e067-447a-a4e4-0acc521f6201 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:37.462871 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-508e6355-e067-447a-a4e4-0acc521f6201 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:37.464131 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-508e6355-e067-447a-a4e4-0acc521f6201 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:37.464563 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-508e6355-e067-447a-a4e4-0acc521f6201 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:37.592146 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-508e6355-e067-447a-a4e4-0acc521f6201 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:37.600150 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-508e6355-e067-447a-a4e4-0acc521f6201 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:37.601627 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-508e6355-e067-447a-a4e4-0acc521f6201 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:37.602794 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-508e6355-e067-447a-a4e4-0acc521f6201 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1749 microversion: 2.20 time: 0.151426 Apr 12 00:30:37.603342 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 291/563] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:37 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:38.150311 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-095cdf5b-6095-4be4-a6f7-e040b950a6ff tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:38.151510 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-095cdf5b-6095-4be4-a6f7-e040b950a6ff tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:38.157596 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-095cdf5b-6095-4be4-a6f7-e040b950a6ff tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:38.158051 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-095cdf5b-6095-4be4-a6f7-e040b950a6ff tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:38.158856 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-095cdf5b-6095-4be4-a6f7-e040b950a6ff tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:38.159294 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-095cdf5b-6095-4be4-a6f7-e040b950a6ff tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:38.288487 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-095cdf5b-6095-4be4-a6f7-e040b950a6ff tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:38.296840 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-095cdf5b-6095-4be4-a6f7-e040b950a6ff tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.150361 Apr 12 00:30:38.297407 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 273/564] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:38 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:38.620924 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-61269400-bb0c-4385-8a9a-720b7296c481 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:38.621500 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-61269400-bb0c-4385-8a9a-720b7296c481 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:38.628021 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-61269400-bb0c-4385-8a9a-720b7296c481 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:38.628488 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-61269400-bb0c-4385-8a9a-720b7296c481 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:38.629239 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-61269400-bb0c-4385-8a9a-720b7296c481 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:38.629666 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-61269400-bb0c-4385-8a9a-720b7296c481 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:38.755463 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-61269400-bb0c-4385-8a9a-720b7296c481 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:38.764144 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-61269400-bb0c-4385-8a9a-720b7296c481 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:38.765629 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-61269400-bb0c-4385-8a9a-720b7296c481 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:38.766794 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-61269400-bb0c-4385-8a9a-720b7296c481 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1751 microversion: 2.20 time: 0.149836 Apr 12 00:30:38.767348 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 292/565] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:38 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:39.157595 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3dd85b5d-bfd7-40e9-8ab9-a8660c6c3320 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:39.158160 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3dd85b5d-bfd7-40e9-8ab9-a8660c6c3320 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:39.164345 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3dd85b5d-bfd7-40e9-8ab9-a8660c6c3320 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:39.165154 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3dd85b5d-bfd7-40e9-8ab9-a8660c6c3320 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:39.165544 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3dd85b5d-bfd7-40e9-8ab9-a8660c6c3320 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:39.165974 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3dd85b5d-bfd7-40e9-8ab9-a8660c6c3320 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:39.190905 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3dd85b5d-bfd7-40e9-8ab9-a8660c6c3320 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Going to try to terminate instance {{(pid=128487) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:30:39.269359 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3dd85b5d-bfd7-40e9-8ab9-a8660c6c3320 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 204 len: 0 microversion: 2.1 time: 0.115313 Apr 12 00:30:39.269947 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 274/566] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:30:39 2022] DELETE /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:30:39.278861 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-13afaa6a-a525-4cae-b141-52db37cf6cb7 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:39.279473 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-13afaa6a-a525-4cae-b141-52db37cf6cb7 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:39.285171 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-13afaa6a-a525-4cae-b141-52db37cf6cb7 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:39.285621 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-13afaa6a-a525-4cae-b141-52db37cf6cb7 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:39.286408 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-13afaa6a-a525-4cae-b141-52db37cf6cb7 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:39.286864 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-13afaa6a-a525-4cae-b141-52db37cf6cb7 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:39.313172 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f0827cce-e969-4ab0-ad65-6e1d72786eb0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:39.313858 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f0827cce-e969-4ab0-ad65-6e1d72786eb0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:39.319613 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f0827cce-e969-4ab0-ad65-6e1d72786eb0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:39.320098 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f0827cce-e969-4ab0-ad65-6e1d72786eb0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:39.320969 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f0827cce-e969-4ab0-ad65-6e1d72786eb0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:39.321396 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f0827cce-e969-4ab0-ad65-6e1d72786eb0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:39.414860 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-13afaa6a-a525-4cae-b141-52db37cf6cb7 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:39.422023 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-13afaa6a-a525-4cae-b141-52db37cf6cb7 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1513 microversion: 2.1 time: 0.147595 Apr 12 00:30:39.422623 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 293/567] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:39 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:39.449641 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f0827cce-e969-4ab0-ad65-6e1d72786eb0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:39.457213 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f0827cce-e969-4ab0-ad65-6e1d72786eb0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.148161 Apr 12 00:30:39.457774 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 275/568] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:39 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:39.785953 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8b398b0a-c5a3-4483-a4ec-a3fd23285e02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:39.786525 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8b398b0a-c5a3-4483-a4ec-a3fd23285e02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:39.793577 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8b398b0a-c5a3-4483-a4ec-a3fd23285e02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:39.794024 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8b398b0a-c5a3-4483-a4ec-a3fd23285e02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:39.794818 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8b398b0a-c5a3-4483-a4ec-a3fd23285e02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:39.795253 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8b398b0a-c5a3-4483-a4ec-a3fd23285e02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:39.918119 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8b398b0a-c5a3-4483-a4ec-a3fd23285e02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:39.926224 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8b398b0a-c5a3-4483-a4ec-a3fd23285e02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:39.927735 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8b398b0a-c5a3-4483-a4ec-a3fd23285e02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:39.928866 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8b398b0a-c5a3-4483-a4ec-a3fd23285e02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.146862 Apr 12 00:30:39.929418 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 294/569] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:39 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:40.439071 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-61caa99d-0cfc-4543-a08b-75fd0fcb89e2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:40.439679 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-61caa99d-0cfc-4543-a08b-75fd0fcb89e2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:40.445900 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-61caa99d-0cfc-4543-a08b-75fd0fcb89e2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:40.446368 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-61caa99d-0cfc-4543-a08b-75fd0fcb89e2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:40.447120 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-61caa99d-0cfc-4543-a08b-75fd0fcb89e2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:40.447543 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-61caa99d-0cfc-4543-a08b-75fd0fcb89e2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:40.474051 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4e9ec095-9a3c-4aeb-8a40-0b7e0a7adc44 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:40.474690 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4e9ec095-9a3c-4aeb-8a40-0b7e0a7adc44 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:40.480451 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4e9ec095-9a3c-4aeb-8a40-0b7e0a7adc44 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:40.480904 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4e9ec095-9a3c-4aeb-8a40-0b7e0a7adc44 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:40.481673 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4e9ec095-9a3c-4aeb-8a40-0b7e0a7adc44 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:40.482112 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4e9ec095-9a3c-4aeb-8a40-0b7e0a7adc44 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:40.573549 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-61caa99d-0cfc-4543-a08b-75fd0fcb89e2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:40.580834 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-61caa99d-0cfc-4543-a08b-75fd0fcb89e2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1513 microversion: 2.1 time: 0.145532 Apr 12 00:30:40.581410 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 276/570] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:40 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:40.607701 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4e9ec095-9a3c-4aeb-8a40-0b7e0a7adc44 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:40.615442 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4e9ec095-9a3c-4aeb-8a40-0b7e0a7adc44 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.145185 Apr 12 00:30:40.616012 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 295/571] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:40 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:40.946467 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-6ea9f0ef-cff9-48c4-ba45-92e4794a3387 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:40.947071 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-6ea9f0ef-cff9-48c4-ba45-92e4794a3387 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:40.953398 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6ea9f0ef-cff9-48c4-ba45-92e4794a3387 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:40.953837 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6ea9f0ef-cff9-48c4-ba45-92e4794a3387 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:40.954603 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6ea9f0ef-cff9-48c4-ba45-92e4794a3387 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:40.955028 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6ea9f0ef-cff9-48c4-ba45-92e4794a3387 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:41.079536 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-6ea9f0ef-cff9-48c4-ba45-92e4794a3387 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:41.087561 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-6ea9f0ef-cff9-48c4-ba45-92e4794a3387 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:41.089656 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-6ea9f0ef-cff9-48c4-ba45-92e4794a3387 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:41.090812 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-6ea9f0ef-cff9-48c4-ba45-92e4794a3387 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.148210 Apr 12 00:30:41.091371 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 277/572] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:40 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:41.596817 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7038dcd1-3e6d-4994-858d-df0c759a1d5b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:41.597424 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7038dcd1-3e6d-4994-858d-df0c759a1d5b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:41.603744 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7038dcd1-3e6d-4994-858d-df0c759a1d5b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:41.604196 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7038dcd1-3e6d-4994-858d-df0c759a1d5b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:41.604959 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7038dcd1-3e6d-4994-858d-df0c759a1d5b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:41.605410 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7038dcd1-3e6d-4994-858d-df0c759a1d5b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:41.632539 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-71070b06-b9aa-40db-8066-842a42818df7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:41.633255 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-71070b06-b9aa-40db-8066-842a42818df7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:41.640357 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71070b06-b9aa-40db-8066-842a42818df7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:41.640931 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71070b06-b9aa-40db-8066-842a42818df7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:41.641824 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71070b06-b9aa-40db-8066-842a42818df7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:41.642405 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71070b06-b9aa-40db-8066-842a42818df7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:41.791053 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7038dcd1-3e6d-4994-858d-df0c759a1d5b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:41.798976 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7038dcd1-3e6d-4994-858d-df0c759a1d5b tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1513 microversion: 2.1 time: 0.205913 Apr 12 00:30:41.799482 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 296/573] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:41 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:41.838977 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-71070b06-b9aa-40db-8066-842a42818df7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:41.846732 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-71070b06-b9aa-40db-8066-842a42818df7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.218060 Apr 12 00:30:41.847298 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 278/574] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:41 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:42.109504 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-fbb8fbea-7c04-4da5-82a3-2a0f157aa995 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:42.110192 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-fbb8fbea-7c04-4da5-82a3-2a0f157aa995 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:42.115885 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fbb8fbea-7c04-4da5-82a3-2a0f157aa995 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:42.116334 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fbb8fbea-7c04-4da5-82a3-2a0f157aa995 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:42.117089 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fbb8fbea-7c04-4da5-82a3-2a0f157aa995 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:42.117523 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fbb8fbea-7c04-4da5-82a3-2a0f157aa995 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:42.268047 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-fbb8fbea-7c04-4da5-82a3-2a0f157aa995 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:42.288238 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-fbb8fbea-7c04-4da5-82a3-2a0f157aa995 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:42.289760 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-fbb8fbea-7c04-4da5-82a3-2a0f157aa995 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:42.290968 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-fbb8fbea-7c04-4da5-82a3-2a0f157aa995 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.185409 Apr 12 00:30:42.302321 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 297/575] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:42 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:30:42.311075 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d409a0c3-5132-4f4c-b3f4-37e4231d3eb2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2065978337", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-989695835", "security_groups": [{"name": "tempest-secgroup-smoke-1352959982"}], "block_device_mapping_v2": [{"uuid": "1bbab0a7-cd7a-4f10-b266-f9b0531ae424", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8a9865c2-0d03-40f9-a71a-607e87040674"}]}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:42.468358 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.network.neutron [None req-d409a0c3-5132-4f4c-b3f4-37e4231d3eb2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] validate_networks() for [('8a9865c2-0d03-40f9-a71a-607e87040674', None, None, None, None, None)] {{(pid=128487) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:30:42.669752 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-862d06b2-f667-4af4-80cc-90fa320121d6 req-e1963142-16be-4243-89a0-bb9e96db9ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b845b619-f58f-4bfd-9a48-df1b1c742def", "name": "network-vif-deleted", "tag": "d9cbe626-bf12-4a6f-94c5-36e54b08b033"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:42.685282 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-862d06b2-f667-4af4-80cc-90fa320121d6 req-e1963142-16be-4243-89a0-bb9e96db9ac9 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:42.685726 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-862d06b2-f667-4af4-80cc-90fa320121d6 req-e1963142-16be-4243-89a0-bb9e96db9ac9 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:42.699397 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-862d06b2-f667-4af4-80cc-90fa320121d6 req-e1963142-16be-4243-89a0-bb9e96db9ac9 service nova] Creating event network-vif-deleted:d9cbe626-bf12-4a6f-94c5-36e54b08b033 for instance b845b619-f58f-4bfd-9a48-df1b1c742def on hv-cinder-83625 Apr 12 00:30:42.705938 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-862d06b2-f667-4af4-80cc-90fa320121d6 req-e1963142-16be-4243-89a0-bb9e96db9ac9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043706 Apr 12 00:30:42.706873 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 298/576] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:30:42.818002 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7b37fc75-485d-4a31-823c-23daf204c84e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:42.819066 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7b37fc75-485d-4a31-823c-23daf204c84e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:42.829938 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b37fc75-485d-4a31-823c-23daf204c84e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:42.833556 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b37fc75-485d-4a31-823c-23daf204c84e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:42.835261 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b37fc75-485d-4a31-823c-23daf204c84e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:42.835723 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b37fc75-485d-4a31-823c-23daf204c84e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:42.935263 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7b37fc75-485d-4a31-823c-23daf204c84e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:42.943165 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7b37fc75-485d-4a31-823c-23daf204c84e tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1471 microversion: 2.1 time: 0.130058 Apr 12 00:30:42.944236 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 299/577] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:42 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1471 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:42.952028 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8acf6a77-b33d-4eab-849c-735b5a7f173f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:42.952884 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8acf6a77-b33d-4eab-849c-735b5a7f173f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:42.959304 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8acf6a77-b33d-4eab-849c-735b5a7f173f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:42.960051 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8acf6a77-b33d-4eab-849c-735b5a7f173f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:42.960890 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8acf6a77-b33d-4eab-849c-735b5a7f173f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:42.961387 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8acf6a77-b33d-4eab-849c-735b5a7f173f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:43.101066 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8acf6a77-b33d-4eab-849c-735b5a7f173f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:43.110056 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8acf6a77-b33d-4eab-849c-735b5a7f173f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.164612 Apr 12 00:30:43.110684 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 300/578] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:42 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:43.259761 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-d409a0c3-5132-4f4c-b3f4-37e4231d3eb2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Flavor limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:30:43.260847 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-d409a0c3-5132-4f4c-b3f4-37e4231d3eb2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Image limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:30:43.261415 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-d409a0c3-5132-4f4c-b3f4-37e4231d3eb2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Flavor pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:30:43.261914 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-d409a0c3-5132-4f4c-b3f4-37e4231d3eb2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Image pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:30:43.262494 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-d409a0c3-5132-4f4c-b3f4-37e4231d3eb2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:30:43.272456 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d409a0c3-5132-4f4c-b3f4-37e4231d3eb2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:43.273553 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d409a0c3-5132-4f4c-b3f4-37e4231d3eb2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:43.274761 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d409a0c3-5132-4f4c-b3f4-37e4231d3eb2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:43.275481 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d409a0c3-5132-4f4c-b3f4-37e4231d3eb2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:43.292941 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-d409a0c3-5132-4f4c-b3f4-37e4231d3eb2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Getting quotas for project 4ad54dac63374c8a9b4da55ee5dc7fd1. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:30:43.296846 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-d409a0c3-5132-4f4c-b3f4-37e4231d3eb2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Getting quotas for user 3b1d212dad5347a888832a779beadece and project 4ad54dac63374c8a9b4da55ee5dc7fd1. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:30:43.311723 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ea2e9943-e89a-49ae-891f-7f976b97d07b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:43.312447 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ea2e9943-e89a-49ae-891f-7f976b97d07b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:43.319214 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ea2e9943-e89a-49ae-891f-7f976b97d07b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:43.324010 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ea2e9943-e89a-49ae-891f-7f976b97d07b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:43.325627 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ea2e9943-e89a-49ae-891f-7f976b97d07b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:43.326366 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ea2e9943-e89a-49ae-891f-7f976b97d07b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:43.373431 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d409a0c3-5132-4f4c-b3f4-37e4231d3eb2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Going to run 1 instances... {{(pid=128487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:30:43.375853 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d409a0c3-5132-4f4c-b3f4-37e4231d3eb2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1bbab0a7-cd7a-4f10-b266-f9b0531ae424',volume_size=None,volume_type=None)] {{(pid=128487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:30:43.477136 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ea2e9943-e89a-49ae-891f-7f976b97d07b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:43.487961 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ea2e9943-e89a-49ae-891f-7f976b97d07b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:43.489789 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ea2e9943-e89a-49ae-891f-7f976b97d07b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:43.491016 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ea2e9943-e89a-49ae-891f-7f976b97d07b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.183426 Apr 12 00:30:43.491773 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 301/579] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:43 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:30:43.524670 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d409a0c3-5132-4f4c-b3f4-37e4231d3eb2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.217925 Apr 12 00:30:43.525431 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 279/580] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:30:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:30:43.535815 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-37f820cd-38f9-459e-91c8-aadeae174874 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:43.536431 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-37f820cd-38f9-459e-91c8-aadeae174874 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:43.606212 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-37f820cd-38f9-459e-91c8-aadeae174874 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:43.613382 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-37f820cd-38f9-459e-91c8-aadeae174874 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1094 microversion: 2.1 time: 0.081532 Apr 12 00:30:43.614190 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 302/581] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:43 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:43.961396 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b29f6e61-82ed-48d2-b6da-428565760a69 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:43.961998 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b29f6e61-82ed-48d2-b6da-428565760a69 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:43.968667 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b29f6e61-82ed-48d2-b6da-428565760a69 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:43.969115 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b29f6e61-82ed-48d2-b6da-428565760a69 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:43.969880 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b29f6e61-82ed-48d2-b6da-428565760a69 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:43.970338 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b29f6e61-82ed-48d2-b6da-428565760a69 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:44.033782 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b29f6e61-82ed-48d2-b6da-428565760a69 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:44.041167 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b29f6e61-82ed-48d2-b6da-428565760a69 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1471 microversion: 2.1 time: 0.084069 Apr 12 00:30:44.042310 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 280/582] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:43 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1471 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:44.127813 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8555fa2b-b7d1-408c-92a2-a83a14a0a7c0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:44.128415 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8555fa2b-b7d1-408c-92a2-a83a14a0a7c0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:44.134962 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8555fa2b-b7d1-408c-92a2-a83a14a0a7c0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:44.135488 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8555fa2b-b7d1-408c-92a2-a83a14a0a7c0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:44.136266 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8555fa2b-b7d1-408c-92a2-a83a14a0a7c0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:44.136704 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8555fa2b-b7d1-408c-92a2-a83a14a0a7c0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:44.265550 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8555fa2b-b7d1-408c-92a2-a83a14a0a7c0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:44.273980 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8555fa2b-b7d1-408c-92a2-a83a14a0a7c0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.149983 Apr 12 00:30:44.274603 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 303/583] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:44 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:44.509734 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e0a88847-cf01-48b2-8523-e3b0a94b5cfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:44.510842 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e0a88847-cf01-48b2-8523-e3b0a94b5cfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:44.516802 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e0a88847-cf01-48b2-8523-e3b0a94b5cfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:44.517246 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e0a88847-cf01-48b2-8523-e3b0a94b5cfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:44.518070 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e0a88847-cf01-48b2-8523-e3b0a94b5cfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:44.518523 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e0a88847-cf01-48b2-8523-e3b0a94b5cfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:44.629932 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-19552735-c8c8-4eda-a57f-532a680e939b tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:44.630574 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-19552735-c8c8-4eda-a57f-532a680e939b tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:44.636811 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-19552735-c8c8-4eda-a57f-532a680e939b tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:44.637261 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-19552735-c8c8-4eda-a57f-532a680e939b tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:44.638039 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-19552735-c8c8-4eda-a57f-532a680e939b tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:44.638505 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-19552735-c8c8-4eda-a57f-532a680e939b tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:44.651868 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e0a88847-cf01-48b2-8523-e3b0a94b5cfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:44.668460 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e0a88847-cf01-48b2-8523-e3b0a94b5cfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:44.670413 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e0a88847-cf01-48b2-8523-e3b0a94b5cfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:44.671770 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e0a88847-cf01-48b2-8523-e3b0a94b5cfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.165886 Apr 12 00:30:44.672431 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 281/584] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:44 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:44.716986 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-19552735-c8c8-4eda-a57f-532a680e939b tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:44.724856 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-19552735-c8c8-4eda-a57f-532a680e939b tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1144 microversion: 2.1 time: 0.098785 Apr 12 00:30:44.725769 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 304/585] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:44 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1144 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:45.059491 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-08386e9d-bd75-48d9-92e0-48a79375c882 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:45.060493 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-08386e9d-bd75-48d9-92e0-48a79375c882 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:45.067428 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-08386e9d-bd75-48d9-92e0-48a79375c882 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:45.067996 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-08386e9d-bd75-48d9-92e0-48a79375c882 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:45.068836 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-08386e9d-bd75-48d9-92e0-48a79375c882 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:45.069361 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-08386e9d-bd75-48d9-92e0-48a79375c882 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:45.131423 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-08386e9d-bd75-48d9-92e0-48a79375c882 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:45.139631 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-08386e9d-bd75-48d9-92e0-48a79375c882 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1471 microversion: 2.1 time: 0.084397 Apr 12 00:30:45.140501 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 282/586] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:45 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1471 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:45.292438 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-97357e3b-7e9f-4263-b166-6eadb5332f31 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:45.293205 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-97357e3b-7e9f-4263-b166-6eadb5332f31 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:45.300130 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-97357e3b-7e9f-4263-b166-6eadb5332f31 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:45.300582 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-97357e3b-7e9f-4263-b166-6eadb5332f31 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:45.301376 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-97357e3b-7e9f-4263-b166-6eadb5332f31 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:45.301806 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-97357e3b-7e9f-4263-b166-6eadb5332f31 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:45.443475 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-97357e3b-7e9f-4263-b166-6eadb5332f31 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:45.452010 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-97357e3b-7e9f-4263-b166-6eadb5332f31 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.164013 Apr 12 00:30:45.452930 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 305/587] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:45 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:45.689821 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5a4caf7c-5b66-43fe-9ade-458c0a4f9de9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:45.690482 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5a4caf7c-5b66-43fe-9ade-458c0a4f9de9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:45.696427 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5a4caf7c-5b66-43fe-9ade-458c0a4f9de9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:45.696875 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5a4caf7c-5b66-43fe-9ade-458c0a4f9de9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:45.697632 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5a4caf7c-5b66-43fe-9ade-458c0a4f9de9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:45.698066 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5a4caf7c-5b66-43fe-9ade-458c0a4f9de9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:45.741993 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-60845e4d-5293-4b4f-96db-17408a4d2f55 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:45.742904 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-60845e4d-5293-4b4f-96db-17408a4d2f55 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:45.753052 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-60845e4d-5293-4b4f-96db-17408a4d2f55 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:45.753496 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-60845e4d-5293-4b4f-96db-17408a4d2f55 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:45.754284 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-60845e4d-5293-4b4f-96db-17408a4d2f55 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:45.754725 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-60845e4d-5293-4b4f-96db-17408a4d2f55 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:45.826334 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-60845e4d-5293-4b4f-96db-17408a4d2f55 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:45.835165 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-60845e4d-5293-4b4f-96db-17408a4d2f55 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1144 microversion: 2.1 time: 0.096894 Apr 12 00:30:45.836067 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 306/588] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:45 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:45.841611 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-5a4caf7c-5b66-43fe-9ade-458c0a4f9de9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:45.851773 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-5a4caf7c-5b66-43fe-9ade-458c0a4f9de9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:45.853399 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-5a4caf7c-5b66-43fe-9ade-458c0a4f9de9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:45.854703 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5a4caf7c-5b66-43fe-9ade-458c0a4f9de9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.168877 Apr 12 00:30:45.855265 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 283/589] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:45 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:46.157644 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4187ce7b-0cb1-43d2-b9f0-e75c12e2e078 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:46.158379 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4187ce7b-0cb1-43d2-b9f0-e75c12e2e078 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:46.164406 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4187ce7b-0cb1-43d2-b9f0-e75c12e2e078 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:46.164891 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4187ce7b-0cb1-43d2-b9f0-e75c12e2e078 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:46.165685 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4187ce7b-0cb1-43d2-b9f0-e75c12e2e078 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:46.166164 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4187ce7b-0cb1-43d2-b9f0-e75c12e2e078 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:46.235169 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4187ce7b-0cb1-43d2-b9f0-e75c12e2e078 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:46.242724 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4187ce7b-0cb1-43d2-b9f0-e75c12e2e078 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1471 microversion: 2.1 time: 0.088792 Apr 12 00:30:46.252544 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 307/590] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:46 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1471 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:46.468863 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-14be3bf9-16b3-48bd-b2cd-f70972faefd9 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:46.469465 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-14be3bf9-16b3-48bd-b2cd-f70972faefd9 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:46.475923 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-14be3bf9-16b3-48bd-b2cd-f70972faefd9 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:46.476366 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-14be3bf9-16b3-48bd-b2cd-f70972faefd9 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:46.477146 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-14be3bf9-16b3-48bd-b2cd-f70972faefd9 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:46.477576 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-14be3bf9-16b3-48bd-b2cd-f70972faefd9 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:46.605638 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-14be3bf9-16b3-48bd-b2cd-f70972faefd9 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:46.613355 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-14be3bf9-16b3-48bd-b2cd-f70972faefd9 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.148325 Apr 12 00:30:46.613921 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 284/591] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:46 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:46.852057 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-d446e7a0-3162-4a9f-a391-c416a618f3e5 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:46.852689 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-d446e7a0-3162-4a9f-a391-c416a618f3e5 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:46.859327 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d446e7a0-3162-4a9f-a391-c416a618f3e5 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:46.859773 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d446e7a0-3162-4a9f-a391-c416a618f3e5 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:46.860520 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d446e7a0-3162-4a9f-a391-c416a618f3e5 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:46.860956 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d446e7a0-3162-4a9f-a391-c416a618f3e5 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:46.872774 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9d7123fb-9368-4688-800a-f2176ac7c626 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:46.873405 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-9d7123fb-9368-4688-800a-f2176ac7c626 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:46.879194 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9d7123fb-9368-4688-800a-f2176ac7c626 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:46.879636 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9d7123fb-9368-4688-800a-f2176ac7c626 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:46.880396 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9d7123fb-9368-4688-800a-f2176ac7c626 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:46.880918 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9d7123fb-9368-4688-800a-f2176ac7c626 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:46.932594 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-d446e7a0-3162-4a9f-a391-c416a618f3e5 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:46.942925 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-d446e7a0-3162-4a9f-a391-c416a618f3e5 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1144 microversion: 2.1 time: 0.094519 Apr 12 00:30:46.943776 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 308/592] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:46 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1144 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:47.015680 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9d7123fb-9368-4688-800a-f2176ac7c626 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:47.030926 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9d7123fb-9368-4688-800a-f2176ac7c626 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:47.032405 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9d7123fb-9368-4688-800a-f2176ac7c626 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:47.033556 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9d7123fb-9368-4688-800a-f2176ac7c626 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.165287 Apr 12 00:30:47.034107 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 285/593] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:46 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:30:47.260939 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-724b3a49-a681-475d-9bb9-c7142712c307 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:47.261547 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-724b3a49-a681-475d-9bb9-c7142712c307 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:47.267541 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-724b3a49-a681-475d-9bb9-c7142712c307 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:47.268013 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-724b3a49-a681-475d-9bb9-c7142712c307 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:47.268763 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-724b3a49-a681-475d-9bb9-c7142712c307 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:47.269200 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-724b3a49-a681-475d-9bb9-c7142712c307 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:47.339907 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-724b3a49-a681-475d-9bb9-c7142712c307 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:47.347651 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-724b3a49-a681-475d-9bb9-c7142712c307 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1471 microversion: 2.1 time: 0.091157 Apr 12 00:30:47.348225 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 309/594] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:47 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1471 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:47.632405 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d7c06961-40fa-4a96-980d-8c9cd76267b4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:47.633023 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d7c06961-40fa-4a96-980d-8c9cd76267b4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:47.639510 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d7c06961-40fa-4a96-980d-8c9cd76267b4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:47.640209 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d7c06961-40fa-4a96-980d-8c9cd76267b4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:47.641255 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d7c06961-40fa-4a96-980d-8c9cd76267b4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:47.641896 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d7c06961-40fa-4a96-980d-8c9cd76267b4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:47.777037 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d7c06961-40fa-4a96-980d-8c9cd76267b4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:47.785216 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d7c06961-40fa-4a96-980d-8c9cd76267b4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.156678 Apr 12 00:30:47.785822 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 286/595] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:47 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:47.959804 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0bf9d06a-db20-4c2a-bfd0-e82ffc50b75f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:47.960558 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0bf9d06a-db20-4c2a-bfd0-e82ffc50b75f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:47.967281 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0bf9d06a-db20-4c2a-bfd0-e82ffc50b75f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:47.967813 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0bf9d06a-db20-4c2a-bfd0-e82ffc50b75f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:47.968791 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0bf9d06a-db20-4c2a-bfd0-e82ffc50b75f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:47.969296 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0bf9d06a-db20-4c2a-bfd0-e82ffc50b75f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:48.030553 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0bf9d06a-db20-4c2a-bfd0-e82ffc50b75f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:48.038614 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0bf9d06a-db20-4c2a-bfd0-e82ffc50b75f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1144 microversion: 2.1 time: 0.082461 Apr 12 00:30:48.039487 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 310/596] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:47 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:48.052259 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b03b3b35-6191-480d-9351-d6c7f928167b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:48.053179 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b03b3b35-6191-480d-9351-d6c7f928167b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:48.059844 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b03b3b35-6191-480d-9351-d6c7f928167b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:48.060380 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b03b3b35-6191-480d-9351-d6c7f928167b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:48.061210 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b03b3b35-6191-480d-9351-d6c7f928167b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:48.061739 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b03b3b35-6191-480d-9351-d6c7f928167b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:48.194646 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b03b3b35-6191-480d-9351-d6c7f928167b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:48.203011 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b03b3b35-6191-480d-9351-d6c7f928167b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:48.205549 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b03b3b35-6191-480d-9351-d6c7f928167b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:48.206745 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b03b3b35-6191-480d-9351-d6c7f928167b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.158349 Apr 12 00:30:48.207330 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 287/597] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:48 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:30:48.365073 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-48e28003-5d40-443b-98a3-c26481f3522c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:48.365630 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-48e28003-5d40-443b-98a3-c26481f3522c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:48.371591 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48e28003-5d40-443b-98a3-c26481f3522c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:48.372040 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48e28003-5d40-443b-98a3-c26481f3522c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:48.372798 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48e28003-5d40-443b-98a3-c26481f3522c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:48.373231 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-48e28003-5d40-443b-98a3-c26481f3522c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:48.433841 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-48e28003-5d40-443b-98a3-c26481f3522c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:48.441256 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-48e28003-5d40-443b-98a3-c26481f3522c tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1471 microversion: 2.1 time: 0.080257 Apr 12 00:30:48.441844 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 311/598] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:48 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1471 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:48.803093 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-33246c02-bc0e-45a6-87f5-bb85ff53e6fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:48.803694 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-33246c02-bc0e-45a6-87f5-bb85ff53e6fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:48.810539 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-33246c02-bc0e-45a6-87f5-bb85ff53e6fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:48.810985 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-33246c02-bc0e-45a6-87f5-bb85ff53e6fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:48.811734 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-33246c02-bc0e-45a6-87f5-bb85ff53e6fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:48.812164 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-33246c02-bc0e-45a6-87f5-bb85ff53e6fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:48.955641 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-33246c02-bc0e-45a6-87f5-bb85ff53e6fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:48.964554 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-33246c02-bc0e-45a6-87f5-bb85ff53e6fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.165126 Apr 12 00:30:48.965196 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 288/599] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:48 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:49.055494 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8ad38a55-cc65-4a8f-8057-52fe4ea25963 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:49.056119 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8ad38a55-cc65-4a8f-8057-52fe4ea25963 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:49.063049 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8ad38a55-cc65-4a8f-8057-52fe4ea25963 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:49.063501 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8ad38a55-cc65-4a8f-8057-52fe4ea25963 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:49.064268 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8ad38a55-cc65-4a8f-8057-52fe4ea25963 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:49.064707 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8ad38a55-cc65-4a8f-8057-52fe4ea25963 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:49.123964 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8ad38a55-cc65-4a8f-8057-52fe4ea25963 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:49.131486 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8ad38a55-cc65-4a8f-8057-52fe4ea25963 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1144 microversion: 2.1 time: 0.079872 Apr 12 00:30:49.132062 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 312/600] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:49 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:49.327281 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c4b74133-12df-45d3-9402-74c3bc282f59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:49.328074 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c4b74133-12df-45d3-9402-74c3bc282f59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:49.334067 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4b74133-12df-45d3-9402-74c3bc282f59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:49.334556 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4b74133-12df-45d3-9402-74c3bc282f59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:49.335413 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4b74133-12df-45d3-9402-74c3bc282f59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:49.335929 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c4b74133-12df-45d3-9402-74c3bc282f59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:49.460952 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e930c320-7d26-4b9a-a2c4-00d82f6bb458 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:49.461561 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e930c320-7d26-4b9a-a2c4-00d82f6bb458 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:49.471286 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c4b74133-12df-45d3-9402-74c3bc282f59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:49.476113 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e930c320-7d26-4b9a-a2c4-00d82f6bb458 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:49.476586 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e930c320-7d26-4b9a-a2c4-00d82f6bb458 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:49.477361 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e930c320-7d26-4b9a-a2c4-00d82f6bb458 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:49.477795 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e930c320-7d26-4b9a-a2c4-00d82f6bb458 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:49.479979 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c4b74133-12df-45d3-9402-74c3bc282f59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:49.481459 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c4b74133-12df-45d3-9402-74c3bc282f59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:49.482617 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c4b74133-12df-45d3-9402-74c3bc282f59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.261195 Apr 12 00:30:49.483206 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 289/601] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:49 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:49.548936 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e930c320-7d26-4b9a-a2c4-00d82f6bb458 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:49.556551 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e930c320-7d26-4b9a-a2c4-00d82f6bb458 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1471 microversion: 2.1 time: 0.099383 Apr 12 00:30:49.557669 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 313/602] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:49 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1471 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:49.785168 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:30:49.785415 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: Tue Apr 12 00:30:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 00:30:49.981132 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1d1a7d20-cdfd-4ef7-a3b2-dbe367b13653 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:49.981733 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1d1a7d20-cdfd-4ef7-a3b2-dbe367b13653 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:49.987959 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1d1a7d20-cdfd-4ef7-a3b2-dbe367b13653 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:49.988397 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1d1a7d20-cdfd-4ef7-a3b2-dbe367b13653 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:49.989144 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1d1a7d20-cdfd-4ef7-a3b2-dbe367b13653 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:49.989579 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1d1a7d20-cdfd-4ef7-a3b2-dbe367b13653 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:50.122010 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1d1a7d20-cdfd-4ef7-a3b2-dbe367b13653 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:50.130041 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1d1a7d20-cdfd-4ef7-a3b2-dbe367b13653 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.152729 Apr 12 00:30:50.130861 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 290/603] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:49 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:50.148551 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9443c3c6-e644-4c28-beff-a9781659877c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:50.150147 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9443c3c6-e644-4c28-beff-a9781659877c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:50.157940 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9443c3c6-e644-4c28-beff-a9781659877c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:50.158515 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9443c3c6-e644-4c28-beff-a9781659877c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:50.159366 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9443c3c6-e644-4c28-beff-a9781659877c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:50.159875 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9443c3c6-e644-4c28-beff-a9781659877c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:50.220422 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9443c3c6-e644-4c28-beff-a9781659877c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:50.227621 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9443c3c6-e644-4c28-beff-a9781659877c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1144 microversion: 2.1 time: 0.083446 Apr 12 00:30:50.228178 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 314/604] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:50 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:50.501526 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-da614a21-51c8-478f-a993-73f94f8fe164 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:50.502140 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-da614a21-51c8-478f-a993-73f94f8fe164 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:50.508415 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-da614a21-51c8-478f-a993-73f94f8fe164 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:50.508862 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-da614a21-51c8-478f-a993-73f94f8fe164 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:50.509621 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-da614a21-51c8-478f-a993-73f94f8fe164 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:50.510058 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-da614a21-51c8-478f-a993-73f94f8fe164 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:50.574303 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-6dfcec01-0dda-42f7-b66b-8de7de8b8e96 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:50.575283 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-6dfcec01-0dda-42f7-b66b-8de7de8b8e96 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:50.581333 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6dfcec01-0dda-42f7-b66b-8de7de8b8e96 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:50.581784 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6dfcec01-0dda-42f7-b66b-8de7de8b8e96 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:50.582607 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6dfcec01-0dda-42f7-b66b-8de7de8b8e96 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:50.583050 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6dfcec01-0dda-42f7-b66b-8de7de8b8e96 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:50.641979 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-da614a21-51c8-478f-a993-73f94f8fe164 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:50.651994 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-da614a21-51c8-478f-a993-73f94f8fe164 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:50.654128 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-da614a21-51c8-478f-a993-73f94f8fe164 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:50.655597 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-da614a21-51c8-478f-a993-73f94f8fe164 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.158069 Apr 12 00:30:50.667215 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-6dfcec01-0dda-42f7-b66b-8de7de8b8e96 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:50.667450 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 291/605] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:50 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:50.668362 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-6dfcec01-0dda-42f7-b66b-8de7de8b8e96 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1471 microversion: 2.1 time: 0.098087 Apr 12 00:30:50.669132 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 315/606] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:50 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1471 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:51.148245 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-28e07012-cb41-47d6-8dde-6caf4a44ce95 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:51.148996 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-28e07012-cb41-47d6-8dde-6caf4a44ce95 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:51.155817 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-28e07012-cb41-47d6-8dde-6caf4a44ce95 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:51.156267 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-28e07012-cb41-47d6-8dde-6caf4a44ce95 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:51.157024 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-28e07012-cb41-47d6-8dde-6caf4a44ce95 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:51.157454 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-28e07012-cb41-47d6-8dde-6caf4a44ce95 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:51.245116 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-94105288-8e0f-46de-b018-d3d2525af6c0 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:51.246202 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-94105288-8e0f-46de-b018-d3d2525af6c0 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:51.259395 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-94105288-8e0f-46de-b018-d3d2525af6c0 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:51.260465 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-94105288-8e0f-46de-b018-d3d2525af6c0 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:51.261126 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-94105288-8e0f-46de-b018-d3d2525af6c0 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:51.261563 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-94105288-8e0f-46de-b018-d3d2525af6c0 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:51.307885 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-28e07012-cb41-47d6-8dde-6caf4a44ce95 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:51.316374 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-28e07012-cb41-47d6-8dde-6caf4a44ce95 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.172264 Apr 12 00:30:51.316951 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 292/607] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:51 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:51.330027 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-94105288-8e0f-46de-b018-d3d2525af6c0 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:51.337242 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-94105288-8e0f-46de-b018-d3d2525af6c0 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1144 microversion: 2.1 time: 0.096312 Apr 12 00:30:51.337794 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 316/608] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:51 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:51.675077 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-51f01354-81c4-4420-8fca-9b5048f6f0af tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:51.675829 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-51f01354-81c4-4420-8fca-9b5048f6f0af tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:51.682593 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-51f01354-81c4-4420-8fca-9b5048f6f0af tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:51.683106 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-51f01354-81c4-4420-8fca-9b5048f6f0af tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:51.683935 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-51f01354-81c4-4420-8fca-9b5048f6f0af tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:51.684431 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-51f01354-81c4-4420-8fca-9b5048f6f0af tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:51.685371 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-83b91673-51ab-4eab-8280-e1c9a1735da8 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:51.685979 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-83b91673-51ab-4eab-8280-e1c9a1735da8 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:51.691980 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-83b91673-51ab-4eab-8280-e1c9a1735da8 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:51.692421 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-83b91673-51ab-4eab-8280-e1c9a1735da8 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:51.693177 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-83b91673-51ab-4eab-8280-e1c9a1735da8 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:51.693606 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-83b91673-51ab-4eab-8280-e1c9a1735da8 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:51.756280 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-83b91673-51ab-4eab-8280-e1c9a1735da8 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:51.782542 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-83b91673-51ab-4eab-8280-e1c9a1735da8 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1471 microversion: 2.1 time: 0.101433 Apr 12 00:30:51.783320 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 317/609] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:51 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1471 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:51.825740 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-51f01354-81c4-4420-8fca-9b5048f6f0af tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:51.836557 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-51f01354-81c4-4420-8fca-9b5048f6f0af tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:51.838873 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-51f01354-81c4-4420-8fca-9b5048f6f0af tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:51.840129 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-51f01354-81c4-4420-8fca-9b5048f6f0af tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.168914 Apr 12 00:30:51.847656 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 293/610] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:51 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:52.353579 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1c7edcad-140d-4847-b4ae-6aaa3d7d38f4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:52.354182 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1c7edcad-140d-4847-b4ae-6aaa3d7d38f4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:52.360485 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1c7edcad-140d-4847-b4ae-6aaa3d7d38f4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:52.360922 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1c7edcad-140d-4847-b4ae-6aaa3d7d38f4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:52.361673 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1c7edcad-140d-4847-b4ae-6aaa3d7d38f4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:52.362106 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1c7edcad-140d-4847-b4ae-6aaa3d7d38f4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:52.435829 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1c7edcad-140d-4847-b4ae-6aaa3d7d38f4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:52.443701 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1c7edcad-140d-4847-b4ae-6aaa3d7d38f4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1144 microversion: 2.1 time: 0.093580 Apr 12 00:30:52.444029 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 294/611] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:52 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:52.450065 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-89ad6b19-35b7-4f3a-b1d7-574c40631d3c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:52.450704 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-89ad6b19-35b7-4f3a-b1d7-574c40631d3c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:52.456600 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-89ad6b19-35b7-4f3a-b1d7-574c40631d3c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:52.457051 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-89ad6b19-35b7-4f3a-b1d7-574c40631d3c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:52.457819 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-89ad6b19-35b7-4f3a-b1d7-574c40631d3c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:52.458274 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-89ad6b19-35b7-4f3a-b1d7-574c40631d3c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:52.588417 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-89ad6b19-35b7-4f3a-b1d7-574c40631d3c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:52.596027 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-89ad6b19-35b7-4f3a-b1d7-574c40631d3c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.266791 Apr 12 00:30:52.596583 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 318/612] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:52 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:52.799918 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-04390462-53cf-4908-8005-4366120ea2e2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:52.800625 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-04390462-53cf-4908-8005-4366120ea2e2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:52.807448 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-04390462-53cf-4908-8005-4366120ea2e2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:52.807894 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-04390462-53cf-4908-8005-4366120ea2e2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:52.808661 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-04390462-53cf-4908-8005-4366120ea2e2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:52.809094 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-04390462-53cf-4908-8005-4366120ea2e2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:52.858388 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1f9c359c-96ab-48c0-83f5-9943d8d84910 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:52.858877 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1f9c359c-96ab-48c0-83f5-9943d8d84910 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:52.875482 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1f9c359c-96ab-48c0-83f5-9943d8d84910 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:52.875957 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1f9c359c-96ab-48c0-83f5-9943d8d84910 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:52.876744 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1f9c359c-96ab-48c0-83f5-9943d8d84910 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:52.877183 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1f9c359c-96ab-48c0-83f5-9943d8d84910 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:52.878823 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-04390462-53cf-4908-8005-4366120ea2e2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:52.887002 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-04390462-53cf-4908-8005-4366120ea2e2 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1471 microversion: 2.1 time: 0.090931 Apr 12 00:30:52.887577 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 295/613] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:52 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1471 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:53.019615 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1f9c359c-96ab-48c0-83f5-9943d8d84910 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:53.029470 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1f9c359c-96ab-48c0-83f5-9943d8d84910 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:53.031353 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1f9c359c-96ab-48c0-83f5-9943d8d84910 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:53.032584 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1f9c359c-96ab-48c0-83f5-9943d8d84910 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.178263 Apr 12 00:30:53.033329 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 319/614] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:52 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:53.460273 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-ad931432-9c5c-4cdb-a73e-e7230f7aef5d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:53.460888 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-ad931432-9c5c-4cdb-a73e-e7230f7aef5d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:53.467208 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ad931432-9c5c-4cdb-a73e-e7230f7aef5d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:53.467665 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ad931432-9c5c-4cdb-a73e-e7230f7aef5d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:53.468450 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ad931432-9c5c-4cdb-a73e-e7230f7aef5d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:53.468879 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ad931432-9c5c-4cdb-a73e-e7230f7aef5d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:53.529887 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ad931432-9c5c-4cdb-a73e-e7230f7aef5d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:53.537313 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-ad931432-9c5c-4cdb-a73e-e7230f7aef5d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1144 microversion: 2.1 time: 0.080950 Apr 12 00:30:53.537871 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 296/615] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:53 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:53.613903 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9d3453ae-23f5-4785-8f78-eba965255a69 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:53.614526 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9d3453ae-23f5-4785-8f78-eba965255a69 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:53.621574 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9d3453ae-23f5-4785-8f78-eba965255a69 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:53.622021 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9d3453ae-23f5-4785-8f78-eba965255a69 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:53.622806 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9d3453ae-23f5-4785-8f78-eba965255a69 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:53.623235 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9d3453ae-23f5-4785-8f78-eba965255a69 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:53.758219 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9d3453ae-23f5-4785-8f78-eba965255a69 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:53.766295 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9d3453ae-23f5-4785-8f78-eba965255a69 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.156184 Apr 12 00:30:53.766871 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 320/616] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:53 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:53.906399 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c6b06887-4c24-4191-8a67-efce6150f58d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:53.907657 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c6b06887-4c24-4191-8a67-efce6150f58d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:53.913750 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c6b06887-4c24-4191-8a67-efce6150f58d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:53.914187 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c6b06887-4c24-4191-8a67-efce6150f58d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:53.914975 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c6b06887-4c24-4191-8a67-efce6150f58d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:53.915521 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c6b06887-4c24-4191-8a67-efce6150f58d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:53.976317 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c6b06887-4c24-4191-8a67-efce6150f58d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:53.984380 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c6b06887-4c24-4191-8a67-efce6150f58d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1471 microversion: 2.1 time: 0.082710 Apr 12 00:30:53.984955 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 297/617] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:53 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1471 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:54.050798 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7a14734a-125b-4a2f-9f54-ebcdd96ebd95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:54.051326 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7a14734a-125b-4a2f-9f54-ebcdd96ebd95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:54.057235 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7a14734a-125b-4a2f-9f54-ebcdd96ebd95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:54.057682 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7a14734a-125b-4a2f-9f54-ebcdd96ebd95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:54.058471 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7a14734a-125b-4a2f-9f54-ebcdd96ebd95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:54.058906 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7a14734a-125b-4a2f-9f54-ebcdd96ebd95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:54.185837 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7a14734a-125b-4a2f-9f54-ebcdd96ebd95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:54.193956 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7a14734a-125b-4a2f-9f54-ebcdd96ebd95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:54.195486 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7a14734a-125b-4a2f-9f54-ebcdd96ebd95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:54.196629 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7a14734a-125b-4a2f-9f54-ebcdd96ebd95 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.149774 Apr 12 00:30:54.197231 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 321/618] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:54 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:30:54.554404 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-19df3425-fc4d-4589-af4b-cd88bd2a7a55 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:54.555009 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-19df3425-fc4d-4589-af4b-cd88bd2a7a55 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:54.561769 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-19df3425-fc4d-4589-af4b-cd88bd2a7a55 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:54.562211 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-19df3425-fc4d-4589-af4b-cd88bd2a7a55 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:54.562984 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-19df3425-fc4d-4589-af4b-cd88bd2a7a55 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:54.563412 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-19df3425-fc4d-4589-af4b-cd88bd2a7a55 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:54.620906 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-19df3425-fc4d-4589-af4b-cd88bd2a7a55 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:54.628048 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-19df3425-fc4d-4589-af4b-cd88bd2a7a55 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1144 microversion: 2.1 time: 0.077503 Apr 12 00:30:54.628607 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 298/619] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:54 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1144 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:54.783950 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-324d2a98-5651-40f6-b100-ffeef3844ab2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:54.784564 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-324d2a98-5651-40f6-b100-ffeef3844ab2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:54.791499 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-324d2a98-5651-40f6-b100-ffeef3844ab2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:54.791958 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-324d2a98-5651-40f6-b100-ffeef3844ab2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:54.792721 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-324d2a98-5651-40f6-b100-ffeef3844ab2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:54.793156 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-324d2a98-5651-40f6-b100-ffeef3844ab2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:54.914451 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-324d2a98-5651-40f6-b100-ffeef3844ab2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:54.922749 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-324d2a98-5651-40f6-b100-ffeef3844ab2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.142664 Apr 12 00:30:54.923315 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 322/620] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:54 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:55.000718 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e077a560-501f-4076-9974-bf8c71652b1d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:55.001320 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e077a560-501f-4076-9974-bf8c71652b1d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:55.007059 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e077a560-501f-4076-9974-bf8c71652b1d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:55.007500 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e077a560-501f-4076-9974-bf8c71652b1d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:55.008246 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e077a560-501f-4076-9974-bf8c71652b1d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:55.008696 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e077a560-501f-4076-9974-bf8c71652b1d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:55.069816 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e077a560-501f-4076-9974-bf8c71652b1d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:55.077465 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e077a560-501f-4076-9974-bf8c71652b1d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1471 microversion: 2.1 time: 0.080584 Apr 12 00:30:55.078025 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 299/621] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:54 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1471 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:55.215980 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-77e830dd-a2e7-4079-a6cb-dcf79bd07ac0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:55.216583 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-77e830dd-a2e7-4079-a6cb-dcf79bd07ac0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:55.222430 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-77e830dd-a2e7-4079-a6cb-dcf79bd07ac0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:55.222879 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-77e830dd-a2e7-4079-a6cb-dcf79bd07ac0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:55.223631 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-77e830dd-a2e7-4079-a6cb-dcf79bd07ac0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:55.224057 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-77e830dd-a2e7-4079-a6cb-dcf79bd07ac0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:55.345911 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-77e830dd-a2e7-4079-a6cb-dcf79bd07ac0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:55.353938 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-77e830dd-a2e7-4079-a6cb-dcf79bd07ac0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:55.355472 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-77e830dd-a2e7-4079-a6cb-dcf79bd07ac0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:55.356609 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-77e830dd-a2e7-4079-a6cb-dcf79bd07ac0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.145124 Apr 12 00:30:55.357154 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 323/622] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:55 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:55.644434 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c18b834e-ebfc-4c2e-916a-b7ccb7258500 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:55.645039 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c18b834e-ebfc-4c2e-916a-b7ccb7258500 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:55.651476 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c18b834e-ebfc-4c2e-916a-b7ccb7258500 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:55.651918 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c18b834e-ebfc-4c2e-916a-b7ccb7258500 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:55.652673 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c18b834e-ebfc-4c2e-916a-b7ccb7258500 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:55.653100 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c18b834e-ebfc-4c2e-916a-b7ccb7258500 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:55.711131 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c18b834e-ebfc-4c2e-916a-b7ccb7258500 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:55.718140 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c18b834e-ebfc-4c2e-916a-b7ccb7258500 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1144 microversion: 2.1 time: 0.077480 Apr 12 00:30:55.718735 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 300/623] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:55 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1144 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:55.939610 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-63c0ddee-d37c-4fd4-8eed-7c2a53a2f7a2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:55.940240 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-63c0ddee-d37c-4fd4-8eed-7c2a53a2f7a2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:55.946565 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-63c0ddee-d37c-4fd4-8eed-7c2a53a2f7a2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:55.947010 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-63c0ddee-d37c-4fd4-8eed-7c2a53a2f7a2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:55.948306 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-63c0ddee-d37c-4fd4-8eed-7c2a53a2f7a2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:55.948735 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-63c0ddee-d37c-4fd4-8eed-7c2a53a2f7a2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:56.073901 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-63c0ddee-d37c-4fd4-8eed-7c2a53a2f7a2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:56.081727 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-63c0ddee-d37c-4fd4-8eed-7c2a53a2f7a2 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1724 microversion: 2.1 time: 0.145907 Apr 12 00:30:56.082301 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 324/624] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:55 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:56.094606 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-aa08b748-ec67-4352-bbe1-738054912dcf tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:56.095217 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-aa08b748-ec67-4352-bbe1-738054912dcf tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:56.100873 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-aa08b748-ec67-4352-bbe1-738054912dcf tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:56.101321 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-aa08b748-ec67-4352-bbe1-738054912dcf tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:56.102087 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-aa08b748-ec67-4352-bbe1-738054912dcf tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:56.102559 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-aa08b748-ec67-4352-bbe1-738054912dcf tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:56.160963 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-aa08b748-ec67-4352-bbe1-738054912dcf tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:56.168124 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-aa08b748-ec67-4352-bbe1-738054912dcf tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1471 microversion: 2.1 time: 0.077353 Apr 12 00:30:56.168691 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 301/625] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:56 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1471 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:56.375201 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7410cf7c-b148-492c-8ce1-66ef64793882 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:56.375713 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7410cf7c-b148-492c-8ce1-66ef64793882 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:56.381632 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7410cf7c-b148-492c-8ce1-66ef64793882 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:56.382083 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7410cf7c-b148-492c-8ce1-66ef64793882 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:56.382869 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7410cf7c-b148-492c-8ce1-66ef64793882 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:56.383307 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7410cf7c-b148-492c-8ce1-66ef64793882 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:56.506091 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7410cf7c-b148-492c-8ce1-66ef64793882 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:56.514132 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7410cf7c-b148-492c-8ce1-66ef64793882 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:56.515650 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7410cf7c-b148-492c-8ce1-66ef64793882 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:56.516797 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7410cf7c-b148-492c-8ce1-66ef64793882 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.145548 Apr 12 00:30:56.517354 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 325/626] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:56 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:56.734458 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-7b4a7722-a568-4058-a7eb-e1d88b84a69d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:56.735069 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-7b4a7722-a568-4058-a7eb-e1d88b84a69d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:56.741364 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7b4a7722-a568-4058-a7eb-e1d88b84a69d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:56.741966 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7b4a7722-a568-4058-a7eb-e1d88b84a69d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:56.742592 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7b4a7722-a568-4058-a7eb-e1d88b84a69d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:56.743026 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7b4a7722-a568-4058-a7eb-e1d88b84a69d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:56.802835 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-7b4a7722-a568-4058-a7eb-e1d88b84a69d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:56.810145 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-7b4a7722-a568-4058-a7eb-e1d88b84a69d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1144 microversion: 2.1 time: 0.079556 Apr 12 00:30:56.810786 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 302/627] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:56 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:57.098760 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-51d66417-10d7-4851-8ad3-d35611286927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:57.099478 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-51d66417-10d7-4851-8ad3-d35611286927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:57.106975 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-51d66417-10d7-4851-8ad3-d35611286927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:57.107420 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-51d66417-10d7-4851-8ad3-d35611286927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:57.108189 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-51d66417-10d7-4851-8ad3-d35611286927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:57.108625 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-51d66417-10d7-4851-8ad3-d35611286927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:57.184935 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-615492c4-5764-4a6b-9b00-aec5d34a48c3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:57.186084 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-615492c4-5764-4a6b-9b00-aec5d34a48c3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:57.196390 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-615492c4-5764-4a6b-9b00-aec5d34a48c3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:57.196839 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-615492c4-5764-4a6b-9b00-aec5d34a48c3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:57.197650 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-615492c4-5764-4a6b-9b00-aec5d34a48c3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:57.198755 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-615492c4-5764-4a6b-9b00-aec5d34a48c3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:57.229389 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-615492c4-5764-4a6b-9b00-aec5d34a48c3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:57.229837 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-615492c4-5764-4a6b-9b00-aec5d34a48c3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:57.230335 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-615492c4-5764-4a6b-9b00-aec5d34a48c3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lazy-loading 'fault' on Instance uuid b845b619-f58f-4bfd-9a48-df1b1c742def {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:30:57.271432 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-615492c4-5764-4a6b-9b00-aec5d34a48c3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:57.271615 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-51d66417-10d7-4851-8ad3-d35611286927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:57.282357 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-51d66417-10d7-4851-8ad3-d35611286927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1701 microversion: 2.1 time: 0.187657 Apr 12 00:30:57.283189 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 326/628] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:57 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1701 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:57.288221 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-615492c4-5764-4a6b-9b00-aec5d34a48c3 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1309 microversion: 2.1 time: 0.107074 Apr 12 00:30:57.289485 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 303/629] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:57 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:57.303855 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0313a10b-d8a5-40b3-85b2-4fbfeee0f1c5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:57.311524 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0313a10b-d8a5-40b3-85b2-4fbfeee0f1c5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:57.311976 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0313a10b-d8a5-40b3-85b2-4fbfeee0f1c5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:57.373181 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0313a10b-d8a5-40b3-85b2-4fbfeee0f1c5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Going to try to start instance {{(pid=128486) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 12 00:30:57.413053 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0313a10b-d8a5-40b3-85b2-4fbfeee0f1c5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "POST /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/action" status: 202 len: 0 microversion: 2.1 time: 0.113042 Apr 12 00:30:57.413645 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 327/630] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Apr 12 00:30:57 2022] POST /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:30:57.422158 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1e8af359-ab9c-441e-8f90-6cbfc7cbf720 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:57.422801 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1e8af359-ab9c-441e-8f90-6cbfc7cbf720 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:57.428828 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1e8af359-ab9c-441e-8f90-6cbfc7cbf720 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:57.429273 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1e8af359-ab9c-441e-8f90-6cbfc7cbf720 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:57.430019 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1e8af359-ab9c-441e-8f90-6cbfc7cbf720 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:57.430484 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1e8af359-ab9c-441e-8f90-6cbfc7cbf720 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:57.535574 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-47dd2d13-5d88-43ba-9ffe-80a2b201ebae tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:57.536269 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-47dd2d13-5d88-43ba-9ffe-80a2b201ebae tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:57.542228 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-47dd2d13-5d88-43ba-9ffe-80a2b201ebae tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:57.542770 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-47dd2d13-5d88-43ba-9ffe-80a2b201ebae tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:57.543528 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-47dd2d13-5d88-43ba-9ffe-80a2b201ebae tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:57.543963 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-47dd2d13-5d88-43ba-9ffe-80a2b201ebae tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:57.553444 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1e8af359-ab9c-441e-8f90-6cbfc7cbf720 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:57.561320 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1e8af359-ab9c-441e-8f90-6cbfc7cbf720 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1710 microversion: 2.1 time: 0.143498 Apr 12 00:30:57.561889 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 304/631] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:57 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1710 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:57.684425 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-47dd2d13-5d88-43ba-9ffe-80a2b201ebae tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:57.692818 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-47dd2d13-5d88-43ba-9ffe-80a2b201ebae tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:57.694339 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-47dd2d13-5d88-43ba-9ffe-80a2b201ebae tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:57.695492 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-47dd2d13-5d88-43ba-9ffe-80a2b201ebae tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.164191 Apr 12 00:30:57.696283 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 328/632] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:57 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:30:57.827687 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d2f23e60-f658-4486-be57-3df7a4b339da tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:57.828294 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d2f23e60-f658-4486-be57-3df7a4b339da tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:57.834482 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d2f23e60-f658-4486-be57-3df7a4b339da tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:57.834931 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d2f23e60-f658-4486-be57-3df7a4b339da tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:57.835694 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d2f23e60-f658-4486-be57-3df7a4b339da tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:57.836127 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d2f23e60-f658-4486-be57-3df7a4b339da tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:57.894526 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d2f23e60-f658-4486-be57-3df7a4b339da tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:57.901989 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d2f23e60-f658-4486-be57-3df7a4b339da tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1192 microversion: 2.1 time: 0.078148 Apr 12 00:30:57.902595 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 305/633] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:57 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1192 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:30:58.305843 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7e354a53-a2d5-4817-8b1d-5624c0a34841 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:58.306887 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7e354a53-a2d5-4817-8b1d-5624c0a34841 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:58.312793 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7e354a53-a2d5-4817-8b1d-5624c0a34841 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:58.313246 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7e354a53-a2d5-4817-8b1d-5624c0a34841 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:58.314000 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7e354a53-a2d5-4817-8b1d-5624c0a34841 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:58.314471 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7e354a53-a2d5-4817-8b1d-5624c0a34841 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:58.343728 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7e354a53-a2d5-4817-8b1d-5624c0a34841 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:58.344171 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7e354a53-a2d5-4817-8b1d-5624c0a34841 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:58.344613 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-7e354a53-a2d5-4817-8b1d-5624c0a34841 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lazy-loading 'fault' on Instance uuid b845b619-f58f-4bfd-9a48-df1b1c742def {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:30:58.383334 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7e354a53-a2d5-4817-8b1d-5624c0a34841 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:58.391087 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7e354a53-a2d5-4817-8b1d-5624c0a34841 tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1309 microversion: 2.1 time: 0.089161 Apr 12 00:30:58.391653 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 329/634] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:58 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1309 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:58.579012 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-ddd53aa4-44e0-4a6c-8141-5964790d71fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:58.579556 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-ddd53aa4-44e0-4a6c-8141-5964790d71fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:58.585309 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ddd53aa4-44e0-4a6c-8141-5964790d71fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:58.585756 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ddd53aa4-44e0-4a6c-8141-5964790d71fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:58.586540 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ddd53aa4-44e0-4a6c-8141-5964790d71fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:58.586974 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ddd53aa4-44e0-4a6c-8141-5964790d71fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:58.713703 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-34dc07f4-dbc5-41ab-90b2-7c18ea80a89b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:58.714358 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-34dc07f4-dbc5-41ab-90b2-7c18ea80a89b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:58.714682 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ddd53aa4-44e0-4a6c-8141-5964790d71fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:58.720684 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-34dc07f4-dbc5-41ab-90b2-7c18ea80a89b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:58.721133 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-34dc07f4-dbc5-41ab-90b2-7c18ea80a89b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:58.721896 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-34dc07f4-dbc5-41ab-90b2-7c18ea80a89b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:58.722330 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-ddd53aa4-44e0-4a6c-8141-5964790d71fa tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1710 microversion: 2.1 time: 0.147194 Apr 12 00:30:58.722459 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-34dc07f4-dbc5-41ab-90b2-7c18ea80a89b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:58.722893 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 306/635] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:58 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1710 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:58.854893 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-34dc07f4-dbc5-41ab-90b2-7c18ea80a89b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:58.863418 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-34dc07f4-dbc5-41ab-90b2-7c18ea80a89b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:58.865038 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-34dc07f4-dbc5-41ab-90b2-7c18ea80a89b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:58.866304 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-34dc07f4-dbc5-41ab-90b2-7c18ea80a89b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.156482 Apr 12 00:30:58.866897 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 330/636] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:58 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:30:58.919765 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4aca6f89-9781-43e4-8ae3-8ae0654e5854 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:58.920369 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-4aca6f89-9781-43e4-8ae3-8ae0654e5854 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:58.926685 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4aca6f89-9781-43e4-8ae3-8ae0654e5854 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:58.927131 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4aca6f89-9781-43e4-8ae3-8ae0654e5854 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:58.928050 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4aca6f89-9781-43e4-8ae3-8ae0654e5854 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:58.928490 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4aca6f89-9781-43e4-8ae3-8ae0654e5854 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:58.988771 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-4aca6f89-9781-43e4-8ae3-8ae0654e5854 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:58.996715 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-4aca6f89-9781-43e4-8ae3-8ae0654e5854 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1192 microversion: 2.1 time: 0.081251 Apr 12 00:30:58.997292 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 307/637] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:58 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:59.411063 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1159cb75-18a3-412c-8bf6-9bba34cf8e4d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:59.411815 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1159cb75-18a3-412c-8bf6-9bba34cf8e4d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:59.419780 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1159cb75-18a3-412c-8bf6-9bba34cf8e4d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:59.420223 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1159cb75-18a3-412c-8bf6-9bba34cf8e4d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:59.420992 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1159cb75-18a3-412c-8bf6-9bba34cf8e4d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:59.421423 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1159cb75-18a3-412c-8bf6-9bba34cf8e4d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:59.465061 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1159cb75-18a3-412c-8bf6-9bba34cf8e4d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:59.465507 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1159cb75-18a3-412c-8bf6-9bba34cf8e4d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:59.465952 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-1159cb75-18a3-412c-8bf6-9bba34cf8e4d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lazy-loading 'fault' on Instance uuid b845b619-f58f-4bfd-9a48-df1b1c742def {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:30:59.505858 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1159cb75-18a3-412c-8bf6-9bba34cf8e4d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c35b046284938a73d4404234c1f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d829832a67942c89c33adf4eea0df20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:30:59.513895 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1159cb75-18a3-412c-8bf6-9bba34cf8e4d tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 200 len: 1309 microversion: 2.1 time: 0.109292 Apr 12 00:30:59.514506 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 331/638] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:59 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:59.739319 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e78ff2db-4276-46c3-affc-a22aa5a0f092 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:59.739922 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e78ff2db-4276-46c3-affc-a22aa5a0f092 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:59.746197 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e78ff2db-4276-46c3-affc-a22aa5a0f092 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:59.746857 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e78ff2db-4276-46c3-affc-a22aa5a0f092 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:59.747640 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e78ff2db-4276-46c3-affc-a22aa5a0f092 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:59.748069 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e78ff2db-4276-46c3-affc-a22aa5a0f092 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:59.885788 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-18af4ea8-72f2-4d4f-a9d0-a4a4e69e3f75 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:59.886626 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-18af4ea8-72f2-4d4f-a9d0-a4a4e69e3f75 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:30:59.892663 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-18af4ea8-72f2-4d4f-a9d0-a4a4e69e3f75 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:59.893178 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-18af4ea8-72f2-4d4f-a9d0-a4a4e69e3f75 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:30:59.894003 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-18af4ea8-72f2-4d4f-a9d0-a4a4e69e3f75 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:30:59.894553 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-18af4ea8-72f2-4d4f-a9d0-a4a4e69e3f75 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:00.022900 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-18af4ea8-72f2-4d4f-a9d0-a4a4e69e3f75 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:00.031233 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-18af4ea8-72f2-4d4f-a9d0-a4a4e69e3f75 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:00.032719 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-18af4ea8-72f2-4d4f-a9d0-a4a4e69e3f75 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:00.034229 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-18af4ea8-72f2-4d4f-a9d0-a4a4e69e3f75 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.152826 Apr 12 00:31:00.034486 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 332/639] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:30:59 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:31:00.039184 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-bb7ae238-7748-4c65-a64d-253de61e8f7a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:00.039396 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-bb7ae238-7748-4c65-a64d-253de61e8f7a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:00.045160 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bb7ae238-7748-4c65-a64d-253de61e8f7a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:00.045688 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bb7ae238-7748-4c65-a64d-253de61e8f7a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:00.046645 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bb7ae238-7748-4c65-a64d-253de61e8f7a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:00.047136 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bb7ae238-7748-4c65-a64d-253de61e8f7a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:00.098620 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e78ff2db-4276-46c3-affc-a22aa5a0f092 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:00.107932 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e78ff2db-4276-46c3-affc-a22aa5a0f092 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1710 microversion: 2.1 time: 0.372079 Apr 12 00:31:00.108733 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 308/640] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:30:59 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1710 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:00.110100 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-bb7ae238-7748-4c65-a64d-253de61e8f7a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:00.117453 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-bb7ae238-7748-4c65-a64d-253de61e8f7a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1210 microversion: 2.1 time: 0.082022 Apr 12 00:31:00.118189 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 333/641] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:00 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:00.531160 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f578945d-c806-4740-a2bc-8d515c1e00ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:00.531714 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f578945d-c806-4740-a2bc-8d515c1e00ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] [instance: b845b619-f58f-4bfd-9a48-df1b1c742def] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:00.537583 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f578945d-c806-4740-a2bc-8d515c1e00ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:00.538026 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f578945d-c806-4740-a2bc-8d515c1e00ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:00.538807 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f578945d-c806-4740-a2bc-8d515c1e00ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:00.539235 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f578945d-c806-4740-a2bc-8d515c1e00ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:00.552229 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-f578945d-c806-4740-a2bc-8d515c1e00ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] HTTP exception thrown: Instance b845b619-f58f-4bfd-9a48-df1b1c742def could not be found. Apr 12 00:31:00.552804 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f578945d-c806-4740-a2bc-8d515c1e00ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] Returning 404 to user: Instance b845b619-f58f-4bfd-9a48-df1b1c742def could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:31:00.553609 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f578945d-c806-4740-a2bc-8d515c1e00ff tempest-VolumesSnapshotTestJSON-2103646297 tempest-VolumesSnapshotTestJSON-2103646297-project] 10.222.0.32 "GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def" status: 404 len: 111 microversion: 2.1 time: 0.026426 Apr 12 00:31:00.554142 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 309/642] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:00 2022] GET /compute/v2.1/servers/b845b619-f58f-4bfd-9a48-df1b1c742def => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 00:31:01.052316 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-77aab61d-35e7-4797-8c61-33d8b07fb53e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:01.052962 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-77aab61d-35e7-4797-8c61-33d8b07fb53e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:01.059404 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-77aab61d-35e7-4797-8c61-33d8b07fb53e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:01.059855 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-77aab61d-35e7-4797-8c61-33d8b07fb53e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:01.060629 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-77aab61d-35e7-4797-8c61-33d8b07fb53e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:01.061071 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-77aab61d-35e7-4797-8c61-33d8b07fb53e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:01.125195 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f066e027-15a5-47a5-bd57-5b3ec14334f5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:01.125799 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f066e027-15a5-47a5-bd57-5b3ec14334f5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:01.132421 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f066e027-15a5-47a5-bd57-5b3ec14334f5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:01.132870 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f066e027-15a5-47a5-bd57-5b3ec14334f5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:01.133636 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f066e027-15a5-47a5-bd57-5b3ec14334f5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:01.134059 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f066e027-15a5-47a5-bd57-5b3ec14334f5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:01.189161 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-77aab61d-35e7-4797-8c61-33d8b07fb53e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:01.197880 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-77aab61d-35e7-4797-8c61-33d8b07fb53e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:01.199611 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-77aab61d-35e7-4797-8c61-33d8b07fb53e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:01.200772 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-77aab61d-35e7-4797-8c61-33d8b07fb53e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.152424 Apr 12 00:31:01.201331 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 334/643] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:01 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:31:01.205693 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-da4d0ef1-d030-48b5-adb1-a6ef75b1edfb tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:01.206321 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-da4d0ef1-d030-48b5-adb1-a6ef75b1edfb tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:01.211917 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-da4d0ef1-d030-48b5-adb1-a6ef75b1edfb tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:01.212366 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-da4d0ef1-d030-48b5-adb1-a6ef75b1edfb tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:01.213744 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-da4d0ef1-d030-48b5-adb1-a6ef75b1edfb tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:01.214177 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-da4d0ef1-d030-48b5-adb1-a6ef75b1edfb tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:01.336281 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f066e027-15a5-47a5-bd57-5b3ec14334f5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:01.339731 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-da4d0ef1-d030-48b5-adb1-a6ef75b1edfb tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:01.344778 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f066e027-15a5-47a5-bd57-5b3ec14334f5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1710 microversion: 2.1 time: 0.223407 Apr 12 00:31:01.345822 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 310/644] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:01 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1710 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:31:01.347143 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-da4d0ef1-d030-48b5-adb1-a6ef75b1edfb tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.144844 Apr 12 00:31:01.347711 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 335/645] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:01 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:01.829502 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-4e932b85-af08-4139-b235-8761c1f6cb3c req-0b8a7a5a-4d2b-4751-a516-dce3f5871f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e46194d7-3e05-4313-b0ca-4ec9cee517f8", "tag": "2ccdca9b-24da-4065-b499-5447b18262ad"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:01.838726 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-4e932b85-af08-4139-b235-8761c1f6cb3c req-0b8a7a5a-4d2b-4751-a516-dce3f5871f40 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:01.839172 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-4e932b85-af08-4139-b235-8761c1f6cb3c req-0b8a7a5a-4d2b-4751-a516-dce3f5871f40 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:01.850275 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-4e932b85-af08-4139-b235-8761c1f6cb3c req-0b8a7a5a-4d2b-4751-a516-dce3f5871f40 service nova] Creating event network-changed:2ccdca9b-24da-4065-b499-5447b18262ad for instance e46194d7-3e05-4313-b0ca-4ec9cee517f8 on hv-cinder-83625 Apr 12 00:31:01.855666 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-4e932b85-af08-4139-b235-8761c1f6cb3c req-0b8a7a5a-4d2b-4751-a516-dce3f5871f40 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029868 Apr 12 00:31:01.856270 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 311/646] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:02.219292 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-15fb25e9-f8ea-4079-9fbe-66001883c161 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:02.219892 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-15fb25e9-f8ea-4079-9fbe-66001883c161 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:02.226077 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-15fb25e9-f8ea-4079-9fbe-66001883c161 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:02.226559 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-15fb25e9-f8ea-4079-9fbe-66001883c161 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:02.227308 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-15fb25e9-f8ea-4079-9fbe-66001883c161 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:02.227736 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-15fb25e9-f8ea-4079-9fbe-66001883c161 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:02.354519 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-15fb25e9-f8ea-4079-9fbe-66001883c161 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:02.362707 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-15fb25e9-f8ea-4079-9fbe-66001883c161 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:02.363031 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-029799a9-575b-41b0-9531-58f60bf0a567 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:02.363754 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-029799a9-575b-41b0-9531-58f60bf0a567 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:02.364204 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-15fb25e9-f8ea-4079-9fbe-66001883c161 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:02.365348 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-15fb25e9-f8ea-4079-9fbe-66001883c161 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.149900 Apr 12 00:31:02.365897 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 336/647] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:02 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:31:02.370840 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-029799a9-575b-41b0-9531-58f60bf0a567 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:02.371285 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-029799a9-575b-41b0-9531-58f60bf0a567 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:02.371500 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-441561d1-cc23-496d-9a0f-edc43e99d380 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:02.372038 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-029799a9-575b-41b0-9531-58f60bf0a567 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:02.372436 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-441561d1-cc23-496d-9a0f-edc43e99d380 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:02.372537 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-029799a9-575b-41b0-9531-58f60bf0a567 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:02.378452 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-441561d1-cc23-496d-9a0f-edc43e99d380 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:02.378966 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-441561d1-cc23-496d-9a0f-edc43e99d380 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:02.379680 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-441561d1-cc23-496d-9a0f-edc43e99d380 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:02.380111 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-441561d1-cc23-496d-9a0f-edc43e99d380 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:02.511562 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-441561d1-cc23-496d-9a0f-edc43e99d380 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:02.519063 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-441561d1-cc23-496d-9a0f-edc43e99d380 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.152183 Apr 12 00:31:02.519726 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 337/648] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:02 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:02.536162 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-029799a9-575b-41b0-9531-58f60bf0a567 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:02.544917 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-029799a9-575b-41b0-9531-58f60bf0a567 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1714 microversion: 2.1 time: 0.185914 Apr 12 00:31:02.545483 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 312/649] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:02 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1714 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:31:03.383970 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-63e76a2c-4d1b-4227-b456-d0c50e868a5b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:03.385037 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-63e76a2c-4d1b-4227-b456-d0c50e868a5b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:03.391257 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-63e76a2c-4d1b-4227-b456-d0c50e868a5b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:03.391705 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-63e76a2c-4d1b-4227-b456-d0c50e868a5b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:03.392460 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-63e76a2c-4d1b-4227-b456-d0c50e868a5b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:03.392893 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-63e76a2c-4d1b-4227-b456-d0c50e868a5b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:03.520495 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-63e76a2c-4d1b-4227-b456-d0c50e868a5b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:03.529197 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-63e76a2c-4d1b-4227-b456-d0c50e868a5b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:03.530699 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-63e76a2c-4d1b-4227-b456-d0c50e868a5b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:03.531875 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-63e76a2c-4d1b-4227-b456-d0c50e868a5b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.151864 Apr 12 00:31:03.532427 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 338/650] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:03 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:31:03.536233 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-8d447444-9b66-45e6-9e3d-7f2b2d0e46fc tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:03.536871 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-8d447444-9b66-45e6-9e3d-7f2b2d0e46fc tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:03.542862 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8d447444-9b66-45e6-9e3d-7f2b2d0e46fc tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:03.543317 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8d447444-9b66-45e6-9e3d-7f2b2d0e46fc tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:03.544081 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8d447444-9b66-45e6-9e3d-7f2b2d0e46fc tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:03.544520 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8d447444-9b66-45e6-9e3d-7f2b2d0e46fc tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:03.672261 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-8d447444-9b66-45e6-9e3d-7f2b2d0e46fc tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:03.679526 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-8d447444-9b66-45e6-9e3d-7f2b2d0e46fc tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.147204 Apr 12 00:31:03.680084 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 313/651] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:03 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:04.549978 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2c633bee-03b6-46de-8664-b8c74fff34c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:04.550610 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-2c633bee-03b6-46de-8664-b8c74fff34c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:04.557304 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2c633bee-03b6-46de-8664-b8c74fff34c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:04.557744 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2c633bee-03b6-46de-8664-b8c74fff34c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:04.558520 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2c633bee-03b6-46de-8664-b8c74fff34c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:04.558954 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2c633bee-03b6-46de-8664-b8c74fff34c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:04.696120 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-33e61cd6-3cf7-4014-bb5e-d55366c5f7c9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:04.696805 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-33e61cd6-3cf7-4014-bb5e-d55366c5f7c9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:04.704155 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-33e61cd6-3cf7-4014-bb5e-d55366c5f7c9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:04.704600 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-33e61cd6-3cf7-4014-bb5e-d55366c5f7c9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:04.705373 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-33e61cd6-3cf7-4014-bb5e-d55366c5f7c9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:04.705801 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-33e61cd6-3cf7-4014-bb5e-d55366c5f7c9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:04.835211 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2c633bee-03b6-46de-8664-b8c74fff34c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:04.837098 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-33e61cd6-3cf7-4014-bb5e-d55366c5f7c9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:04.844589 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-33e61cd6-3cf7-4014-bb5e-d55366c5f7c9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.152416 Apr 12 00:31:04.845025 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2c633bee-03b6-46de-8664-b8c74fff34c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:04.847619 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 314/652] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:04 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:31:04.847764 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2c633bee-03b6-46de-8664-b8c74fff34c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:04.847764 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2c633bee-03b6-46de-8664-b8c74fff34c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.301622 Apr 12 00:31:04.848275 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 339/653] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:04 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:31:05.861605 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f43d1810-6af4-4bca-8947-9a0a0efa97af tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:05.862217 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f43d1810-6af4-4bca-8947-9a0a0efa97af tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:05.865944 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f87def7a-13a7-4e0c-899c-591cfc6d6b8e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:05.866580 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f87def7a-13a7-4e0c-899c-591cfc6d6b8e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:05.868765 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f43d1810-6af4-4bca-8947-9a0a0efa97af tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:05.869204 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f43d1810-6af4-4bca-8947-9a0a0efa97af tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:05.869961 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f43d1810-6af4-4bca-8947-9a0a0efa97af tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:05.870419 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f43d1810-6af4-4bca-8947-9a0a0efa97af tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:05.872782 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f87def7a-13a7-4e0c-899c-591cfc6d6b8e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:05.873232 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f87def7a-13a7-4e0c-899c-591cfc6d6b8e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:05.874055 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f87def7a-13a7-4e0c-899c-591cfc6d6b8e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:05.874471 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f87def7a-13a7-4e0c-899c-591cfc6d6b8e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:05.997104 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f87def7a-13a7-4e0c-899c-591cfc6d6b8e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:05.997341 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f43d1810-6af4-4bca-8947-9a0a0efa97af tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:06.004474 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f43d1810-6af4-4bca-8947-9a0a0efa97af tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.146691 Apr 12 00:31:06.005043 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 315/654] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:05 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:06.005526 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f87def7a-13a7-4e0c-899c-591cfc6d6b8e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:06.007090 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f87def7a-13a7-4e0c-899c-591cfc6d6b8e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:06.008271 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f87def7a-13a7-4e0c-899c-591cfc6d6b8e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.146063 Apr 12 00:31:06.008818 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 340/655] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:05 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:31:07.021359 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c64609d4-ec51-4ee9-b3f1-4a94c103e910 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:07.022012 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c64609d4-ec51-4ee9-b3f1-4a94c103e910 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:07.026338 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a61d568e-1c0b-42a0-9382-c6c7b2086afb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:07.026952 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a61d568e-1c0b-42a0-9382-c6c7b2086afb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:07.027930 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c64609d4-ec51-4ee9-b3f1-4a94c103e910 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:07.028380 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c64609d4-ec51-4ee9-b3f1-4a94c103e910 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:07.029143 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c64609d4-ec51-4ee9-b3f1-4a94c103e910 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:07.029572 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c64609d4-ec51-4ee9-b3f1-4a94c103e910 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:07.033099 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a61d568e-1c0b-42a0-9382-c6c7b2086afb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:07.033542 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a61d568e-1c0b-42a0-9382-c6c7b2086afb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:07.034342 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a61d568e-1c0b-42a0-9382-c6c7b2086afb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:07.034781 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a61d568e-1c0b-42a0-9382-c6c7b2086afb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:07.156542 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c64609d4-ec51-4ee9-b3f1-4a94c103e910 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:07.162396 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a61d568e-1c0b-42a0-9382-c6c7b2086afb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:07.163976 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c64609d4-ec51-4ee9-b3f1-4a94c103e910 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.146971 Apr 12 00:31:07.164623 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 316/656] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:07 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:07.171128 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a61d568e-1c0b-42a0-9382-c6c7b2086afb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:07.172617 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a61d568e-1c0b-42a0-9382-c6c7b2086afb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:07.173754 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a61d568e-1c0b-42a0-9382-c6c7b2086afb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.151299 Apr 12 00:31:07.174329 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 341/657] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:07 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:31:08.180514 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-7fadd7ef-2248-4410-b79d-066648e54625 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:08.181676 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-7fadd7ef-2248-4410-b79d-066648e54625 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:08.188068 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7fadd7ef-2248-4410-b79d-066648e54625 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:08.188517 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7fadd7ef-2248-4410-b79d-066648e54625 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:08.189280 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7fadd7ef-2248-4410-b79d-066648e54625 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:08.189712 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7fadd7ef-2248-4410-b79d-066648e54625 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:08.191911 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ec447cb7-4c2e-4a40-b3de-42ed3d5cb584 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:08.192521 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ec447cb7-4c2e-4a40-b3de-42ed3d5cb584 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:08.199360 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ec447cb7-4c2e-4a40-b3de-42ed3d5cb584 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:08.199816 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ec447cb7-4c2e-4a40-b3de-42ed3d5cb584 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:08.200584 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ec447cb7-4c2e-4a40-b3de-42ed3d5cb584 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:08.201023 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ec447cb7-4c2e-4a40-b3de-42ed3d5cb584 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:08.320875 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-7fadd7ef-2248-4410-b79d-066648e54625 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:08.328000 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ec447cb7-4c2e-4a40-b3de-42ed3d5cb584 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:08.328263 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-7fadd7ef-2248-4410-b79d-066648e54625 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.151591 Apr 12 00:31:08.328835 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 317/658] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:08 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:08.336396 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ec447cb7-4c2e-4a40-b3de-42ed3d5cb584 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:08.338430 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ec447cb7-4c2e-4a40-b3de-42ed3d5cb584 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:08.339580 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ec447cb7-4c2e-4a40-b3de-42ed3d5cb584 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.151721 Apr 12 00:31:08.340122 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 342/659] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:08 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:31:09.345291 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-32960ee5-f59c-4d88-93ad-c0ccca222cb7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:09.345905 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-32960ee5-f59c-4d88-93ad-c0ccca222cb7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:09.352086 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-32960ee5-f59c-4d88-93ad-c0ccca222cb7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:09.352532 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-32960ee5-f59c-4d88-93ad-c0ccca222cb7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:09.353803 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-32960ee5-f59c-4d88-93ad-c0ccca222cb7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:09.354238 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-32960ee5-f59c-4d88-93ad-c0ccca222cb7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:09.358658 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ce5c9dc5-b872-4fe8-931e-2de99cec2346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:09.359264 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ce5c9dc5-b872-4fe8-931e-2de99cec2346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:09.365464 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ce5c9dc5-b872-4fe8-931e-2de99cec2346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:09.365911 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ce5c9dc5-b872-4fe8-931e-2de99cec2346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:09.366698 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ce5c9dc5-b872-4fe8-931e-2de99cec2346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:09.367132 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ce5c9dc5-b872-4fe8-931e-2de99cec2346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:09.486898 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-32960ee5-f59c-4d88-93ad-c0ccca222cb7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:09.494313 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-32960ee5-f59c-4d88-93ad-c0ccca222cb7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.152795 Apr 12 00:31:09.494910 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 318/660] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:09 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:09.495295 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ce5c9dc5-b872-4fe8-931e-2de99cec2346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:09.503506 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ce5c9dc5-b872-4fe8-931e-2de99cec2346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:09.505089 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ce5c9dc5-b872-4fe8-931e-2de99cec2346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:09.506224 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ce5c9dc5-b872-4fe8-931e-2de99cec2346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.151395 Apr 12 00:31:09.506793 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 343/661] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:09 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:31:10.510421 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c3bc0c95-3c58-498f-b02a-bbabf3c90ab6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:10.511032 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c3bc0c95-3c58-498f-b02a-bbabf3c90ab6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:10.517261 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c3bc0c95-3c58-498f-b02a-bbabf3c90ab6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:10.517761 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c3bc0c95-3c58-498f-b02a-bbabf3c90ab6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:10.518500 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c3bc0c95-3c58-498f-b02a-bbabf3c90ab6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:10.518936 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c3bc0c95-3c58-498f-b02a-bbabf3c90ab6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:10.526327 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-258c0222-66e9-4d32-ad0e-75e2ad7e2dd0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:10.526935 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-258c0222-66e9-4d32-ad0e-75e2ad7e2dd0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:10.533073 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-258c0222-66e9-4d32-ad0e-75e2ad7e2dd0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:10.533520 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-258c0222-66e9-4d32-ad0e-75e2ad7e2dd0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:10.534297 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-258c0222-66e9-4d32-ad0e-75e2ad7e2dd0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:10.534735 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-258c0222-66e9-4d32-ad0e-75e2ad7e2dd0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:10.648183 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c3bc0c95-3c58-498f-b02a-bbabf3c90ab6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:10.655967 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c3bc0c95-3c58-498f-b02a-bbabf3c90ab6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.149317 Apr 12 00:31:10.656541 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 319/662] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:10 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:10.659673 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-258c0222-66e9-4d32-ad0e-75e2ad7e2dd0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:10.668638 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-258c0222-66e9-4d32-ad0e-75e2ad7e2dd0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:10.670128 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-258c0222-66e9-4d32-ad0e-75e2ad7e2dd0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:10.671300 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-258c0222-66e9-4d32-ad0e-75e2ad7e2dd0 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.149332 Apr 12 00:31:10.671857 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 344/663] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:10 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:31:11.672635 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-262a2807-e773-40db-a05f-41f7a762285f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:11.673251 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-262a2807-e773-40db-a05f-41f7a762285f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:11.679491 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-262a2807-e773-40db-a05f-41f7a762285f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:11.679948 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-262a2807-e773-40db-a05f-41f7a762285f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:11.680714 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-262a2807-e773-40db-a05f-41f7a762285f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:11.681156 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-262a2807-e773-40db-a05f-41f7a762285f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:11.688757 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e1605200-71ad-4f5a-b7f4-76c4d54d01be tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:11.689375 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e1605200-71ad-4f5a-b7f4-76c4d54d01be tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:11.695635 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e1605200-71ad-4f5a-b7f4-76c4d54d01be tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:11.696087 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e1605200-71ad-4f5a-b7f4-76c4d54d01be tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:11.697366 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e1605200-71ad-4f5a-b7f4-76c4d54d01be tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:11.697810 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e1605200-71ad-4f5a-b7f4-76c4d54d01be tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:11.808738 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-262a2807-e773-40db-a05f-41f7a762285f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:11.816116 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-262a2807-e773-40db-a05f-41f7a762285f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.147324 Apr 12 00:31:11.816777 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 320/664] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:11 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:11.830423 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e1605200-71ad-4f5a-b7f4-76c4d54d01be tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:11.839344 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e1605200-71ad-4f5a-b7f4-76c4d54d01be tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:11.840833 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e1605200-71ad-4f5a-b7f4-76c4d54d01be tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:11.841970 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e1605200-71ad-4f5a-b7f4-76c4d54d01be tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.157104 Apr 12 00:31:11.842545 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 345/665] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:11 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:31:12.832841 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-549c5520-0b91-4faa-bc11-1b647a1889db tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:12.833449 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-549c5520-0b91-4faa-bc11-1b647a1889db tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:12.839870 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-549c5520-0b91-4faa-bc11-1b647a1889db tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:12.840318 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-549c5520-0b91-4faa-bc11-1b647a1889db tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:12.841109 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-549c5520-0b91-4faa-bc11-1b647a1889db tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:12.841541 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-549c5520-0b91-4faa-bc11-1b647a1889db tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:12.859955 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a0e4cb1d-a4fe-4104-996c-b8a58ddfde80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:12.860551 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a0e4cb1d-a4fe-4104-996c-b8a58ddfde80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:12.866726 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a0e4cb1d-a4fe-4104-996c-b8a58ddfde80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:12.867173 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a0e4cb1d-a4fe-4104-996c-b8a58ddfde80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:12.867934 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a0e4cb1d-a4fe-4104-996c-b8a58ddfde80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:12.868886 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a0e4cb1d-a4fe-4104-996c-b8a58ddfde80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:12.971439 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-549c5520-0b91-4faa-bc11-1b647a1889db tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:12.979254 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-549c5520-0b91-4faa-bc11-1b647a1889db tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.150228 Apr 12 00:31:12.980035 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 321/666] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:12 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:12.994606 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a0e4cb1d-a4fe-4104-996c-b8a58ddfde80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:13.002786 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a0e4cb1d-a4fe-4104-996c-b8a58ddfde80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:13.004301 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a0e4cb1d-a4fe-4104-996c-b8a58ddfde80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:13.005451 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a0e4cb1d-a4fe-4104-996c-b8a58ddfde80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.149361 Apr 12 00:31:13.006013 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 346/667] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:12 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:31:13.995896 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5706f7e0-113f-49bc-a156-a40462d6d707 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:13.996508 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5706f7e0-113f-49bc-a156-a40462d6d707 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:14.002716 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5706f7e0-113f-49bc-a156-a40462d6d707 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:14.003164 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5706f7e0-113f-49bc-a156-a40462d6d707 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:14.003983 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5706f7e0-113f-49bc-a156-a40462d6d707 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:14.004414 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5706f7e0-113f-49bc-a156-a40462d6d707 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:14.023786 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-d23d10ca-0ec0-4a89-ad5e-6a8270c30bb6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:14.024549 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-d23d10ca-0ec0-4a89-ad5e-6a8270c30bb6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:14.031094 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d23d10ca-0ec0-4a89-ad5e-6a8270c30bb6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:14.031537 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d23d10ca-0ec0-4a89-ad5e-6a8270c30bb6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:14.032293 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d23d10ca-0ec0-4a89-ad5e-6a8270c30bb6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:14.032726 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d23d10ca-0ec0-4a89-ad5e-6a8270c30bb6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:14.135652 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-5706f7e0-113f-49bc-a156-a40462d6d707 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:14.142949 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5706f7e0-113f-49bc-a156-a40462d6d707 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.151024 Apr 12 00:31:14.143725 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 322/668] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:13 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:14.158616 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-d23d10ca-0ec0-4a89-ad5e-6a8270c30bb6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:14.166775 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-d23d10ca-0ec0-4a89-ad5e-6a8270c30bb6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:14.168267 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-d23d10ca-0ec0-4a89-ad5e-6a8270c30bb6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:14.169405 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-d23d10ca-0ec0-4a89-ad5e-6a8270c30bb6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.149746 Apr 12 00:31:14.170298 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 347/669] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:14 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:31:15.160314 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f1d867be-0344-4715-88d2-16a49afe6d72 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:15.160905 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f1d867be-0344-4715-88d2-16a49afe6d72 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:15.167737 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f1d867be-0344-4715-88d2-16a49afe6d72 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:15.168181 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f1d867be-0344-4715-88d2-16a49afe6d72 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:15.168930 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f1d867be-0344-4715-88d2-16a49afe6d72 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:15.169356 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f1d867be-0344-4715-88d2-16a49afe6d72 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:15.187685 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f711e48d-0357-4c15-a784-87896bc3bd02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:15.188411 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f711e48d-0357-4c15-a784-87896bc3bd02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:15.194654 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f711e48d-0357-4c15-a784-87896bc3bd02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:15.195104 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f711e48d-0357-4c15-a784-87896bc3bd02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:15.195873 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f711e48d-0357-4c15-a784-87896bc3bd02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:15.196313 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f711e48d-0357-4c15-a784-87896bc3bd02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:15.301020 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f1d867be-0344-4715-88d2-16a49afe6d72 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:15.308468 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f1d867be-0344-4715-88d2-16a49afe6d72 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.151952 Apr 12 00:31:15.309247 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 323/670] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:15 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:15.326458 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f711e48d-0357-4c15-a784-87896bc3bd02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:15.334644 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f711e48d-0357-4c15-a784-87896bc3bd02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:15.336135 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f711e48d-0357-4c15-a784-87896bc3bd02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:15.337933 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f711e48d-0357-4c15-a784-87896bc3bd02 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.153522 Apr 12 00:31:15.338519 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 348/671] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:15 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:31:16.324994 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-ab36fbb5-61f2-42f1-8e6e-3ebff4979a7c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:16.325607 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-ab36fbb5-61f2-42f1-8e6e-3ebff4979a7c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:16.331768 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ab36fbb5-61f2-42f1-8e6e-3ebff4979a7c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:16.332216 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ab36fbb5-61f2-42f1-8e6e-3ebff4979a7c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:16.332979 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ab36fbb5-61f2-42f1-8e6e-3ebff4979a7c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:16.333413 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ab36fbb5-61f2-42f1-8e6e-3ebff4979a7c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:16.356368 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-dfb2f0fc-ed27-4768-9683-42e81463e947 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:16.356984 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-dfb2f0fc-ed27-4768-9683-42e81463e947 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:16.363344 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dfb2f0fc-ed27-4768-9683-42e81463e947 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:16.363797 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dfb2f0fc-ed27-4768-9683-42e81463e947 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:16.364559 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dfb2f0fc-ed27-4768-9683-42e81463e947 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:16.364996 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dfb2f0fc-ed27-4768-9683-42e81463e947 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:16.460171 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-ab36fbb5-61f2-42f1-8e6e-3ebff4979a7c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:16.468122 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-ab36fbb5-61f2-42f1-8e6e-3ebff4979a7c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.147362 Apr 12 00:31:16.468726 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 324/672] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:16 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:16.492880 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-dfb2f0fc-ed27-4768-9683-42e81463e947 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:16.500967 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-dfb2f0fc-ed27-4768-9683-42e81463e947 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:16.502496 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-dfb2f0fc-ed27-4768-9683-42e81463e947 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:16.503712 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-dfb2f0fc-ed27-4768-9683-42e81463e947 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.151817 Apr 12 00:31:16.504261 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 349/673] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:16 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:31:16.997435 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-39c8ebd7-ee1b-48cf-92d7-748f83457be0 req-f2bf2ebf-faf3-47d3-b910-e1a4bcb55509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c4e615-6c86-41a2-b6a5-19371b76e311", "name": "network-vif-plugged", "status": "completed", "tag": "a96b86a8-a90d-426f-9b7e-b2dc136b138a"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:17.005425 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-39c8ebd7-ee1b-48cf-92d7-748f83457be0 req-f2bf2ebf-faf3-47d3-b910-e1a4bcb55509 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:17.005865 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-39c8ebd7-ee1b-48cf-92d7-748f83457be0 req-f2bf2ebf-faf3-47d3-b910-e1a4bcb55509 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:17.017140 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-39c8ebd7-ee1b-48cf-92d7-748f83457be0 req-f2bf2ebf-faf3-47d3-b910-e1a4bcb55509 service nova] Creating event network-vif-plugged:a96b86a8-a90d-426f-9b7e-b2dc136b138a for instance 02c4e615-6c86-41a2-b6a5-19371b76e311 on hv-cinder-83625 Apr 12 00:31:17.022430 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-39c8ebd7-ee1b-48cf-92d7-748f83457be0 req-f2bf2ebf-faf3-47d3-b910-e1a4bcb55509 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028623 Apr 12 00:31:17.023026 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 325/674] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:17.484774 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8fbf599a-402c-4fd7-82e2-16ecb8555942 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:17.485385 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8fbf599a-402c-4fd7-82e2-16ecb8555942 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:17.491487 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8fbf599a-402c-4fd7-82e2-16ecb8555942 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:17.491934 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8fbf599a-402c-4fd7-82e2-16ecb8555942 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:17.492706 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8fbf599a-402c-4fd7-82e2-16ecb8555942 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:17.493145 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8fbf599a-402c-4fd7-82e2-16ecb8555942 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:17.522232 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b2640a11-911f-4a75-93e6-1f30cd15aa8c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:17.523210 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b2640a11-911f-4a75-93e6-1f30cd15aa8c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:17.529806 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b2640a11-911f-4a75-93e6-1f30cd15aa8c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:17.530275 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b2640a11-911f-4a75-93e6-1f30cd15aa8c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:17.531057 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b2640a11-911f-4a75-93e6-1f30cd15aa8c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:17.531488 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b2640a11-911f-4a75-93e6-1f30cd15aa8c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:17.651313 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8fbf599a-402c-4fd7-82e2-16ecb8555942 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:17.660584 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8fbf599a-402c-4fd7-82e2-16ecb8555942 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.179616 Apr 12 00:31:17.664545 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 350/675] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:17 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:17.702525 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b2640a11-911f-4a75-93e6-1f30cd15aa8c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:17.711445 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b2640a11-911f-4a75-93e6-1f30cd15aa8c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:17.713266 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b2640a11-911f-4a75-93e6-1f30cd15aa8c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:17.714771 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b2640a11-911f-4a75-93e6-1f30cd15aa8c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.197556 Apr 12 00:31:17.715587 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 326/676] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:17 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:31:18.677676 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-fcf4855b-ec8a-415e-9284-bfa76a32971d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:18.678392 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-fcf4855b-ec8a-415e-9284-bfa76a32971d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:18.684972 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fcf4855b-ec8a-415e-9284-bfa76a32971d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:18.685418 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fcf4855b-ec8a-415e-9284-bfa76a32971d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:18.686181 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fcf4855b-ec8a-415e-9284-bfa76a32971d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:18.686638 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fcf4855b-ec8a-415e-9284-bfa76a32971d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:18.735166 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2d51311f-903d-463a-b7c0-74c4d5113111 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:18.735764 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2d51311f-903d-463a-b7c0-74c4d5113111 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:18.742493 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2d51311f-903d-463a-b7c0-74c4d5113111 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:18.742927 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2d51311f-903d-463a-b7c0-74c4d5113111 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:18.744011 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2d51311f-903d-463a-b7c0-74c4d5113111 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:18.744489 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2d51311f-903d-463a-b7c0-74c4d5113111 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:18.832085 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-fcf4855b-ec8a-415e-9284-bfa76a32971d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:18.840512 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-fcf4855b-ec8a-415e-9284-bfa76a32971d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.166689 Apr 12 00:31:18.841082 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 351/677] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:18 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:18.924687 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2d51311f-903d-463a-b7c0-74c4d5113111 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:18.933898 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2d51311f-903d-463a-b7c0-74c4d5113111 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:18.943586 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2d51311f-903d-463a-b7c0-74c4d5113111 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:18.944789 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2d51311f-903d-463a-b7c0-74c4d5113111 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.213557 Apr 12 00:31:18.945402 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 327/678] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:18 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:31:19.857790 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-bdf43956-fe01-4e56-ad0a-239695dfbac6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:19.858339 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-bdf43956-fe01-4e56-ad0a-239695dfbac6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:19.864500 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bdf43956-fe01-4e56-ad0a-239695dfbac6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:19.864947 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bdf43956-fe01-4e56-ad0a-239695dfbac6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:19.865702 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bdf43956-fe01-4e56-ad0a-239695dfbac6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:19.866134 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bdf43956-fe01-4e56-ad0a-239695dfbac6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:19.965891 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-0e2e8046-093a-4282-919e-00d44d6c91eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:19.966523 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-0e2e8046-093a-4282-919e-00d44d6c91eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:19.972894 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0e2e8046-093a-4282-919e-00d44d6c91eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:19.973330 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0e2e8046-093a-4282-919e-00d44d6c91eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:19.974092 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0e2e8046-093a-4282-919e-00d44d6c91eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:19.974620 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0e2e8046-093a-4282-919e-00d44d6c91eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:19.998932 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-bdf43956-fe01-4e56-ad0a-239695dfbac6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:20.007382 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-bdf43956-fe01-4e56-ad0a-239695dfbac6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.153339 Apr 12 00:31:20.008343 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 352/679] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:19 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:20.106810 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-0e2e8046-093a-4282-919e-00d44d6c91eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:20.115211 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-0e2e8046-093a-4282-919e-00d44d6c91eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:20.116644 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-0e2e8046-093a-4282-919e-00d44d6c91eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:20.117783 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-0e2e8046-093a-4282-919e-00d44d6c91eb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.159198 Apr 12 00:31:20.118889 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 328/680] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:19 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:31:21.025800 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b5ee4282-157f-4e56-b757-a268110d4f8f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:21.026552 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b5ee4282-157f-4e56-b757-a268110d4f8f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:21.035374 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b5ee4282-157f-4e56-b757-a268110d4f8f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:21.035899 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b5ee4282-157f-4e56-b757-a268110d4f8f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:21.036797 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b5ee4282-157f-4e56-b757-a268110d4f8f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:21.037210 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b5ee4282-157f-4e56-b757-a268110d4f8f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:21.137754 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-79f280a5-240b-4c84-9e52-9085a23e1e55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:21.139052 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-79f280a5-240b-4c84-9e52-9085a23e1e55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:21.152593 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-79f280a5-240b-4c84-9e52-9085a23e1e55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:21.153104 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-79f280a5-240b-4c84-9e52-9085a23e1e55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:21.153956 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-79f280a5-240b-4c84-9e52-9085a23e1e55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:21.156908 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-79f280a5-240b-4c84-9e52-9085a23e1e55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:21.206457 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b5ee4282-157f-4e56-b757-a268110d4f8f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:21.216688 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b5ee4282-157f-4e56-b757-a268110d4f8f tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.195347 Apr 12 00:31:21.217305 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 353/681] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:21 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:21.310966 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-25467ac4-0be7-4e48-8fc3-f2166478b7e8 req-acc34abb-6b11-4d54-9a3e-784332a2b8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e46194d7-3e05-4313-b0ca-4ec9cee517f8", "name": "network-vif-plugged", "status": "completed", "tag": "2ccdca9b-24da-4065-b499-5447b18262ad"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:21.319855 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-25467ac4-0be7-4e48-8fc3-f2166478b7e8 req-acc34abb-6b11-4d54-9a3e-784332a2b8ee service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:21.320640 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-25467ac4-0be7-4e48-8fc3-f2166478b7e8 req-acc34abb-6b11-4d54-9a3e-784332a2b8ee service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:21.334369 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-25467ac4-0be7-4e48-8fc3-f2166478b7e8 req-acc34abb-6b11-4d54-9a3e-784332a2b8ee service nova] Creating event network-vif-plugged:2ccdca9b-24da-4065-b499-5447b18262ad for instance e46194d7-3e05-4313-b0ca-4ec9cee517f8 on hv-cinder-83625 Apr 12 00:31:21.339851 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-25467ac4-0be7-4e48-8fc3-f2166478b7e8 req-acc34abb-6b11-4d54-9a3e-784332a2b8ee service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100336 Apr 12 00:31:21.340849 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 354/682] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:31:21.341521 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-79f280a5-240b-4c84-9e52-9085a23e1e55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:21.351561 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-79f280a5-240b-4c84-9e52-9085a23e1e55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:21.353945 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-79f280a5-240b-4c84-9e52-9085a23e1e55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:21.355200 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-79f280a5-240b-4c84-9e52-9085a23e1e55 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1807 microversion: 2.20 time: 0.221907 Apr 12 00:31:21.355773 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 329/683] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:21 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:31:22.234495 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7b3d3a39-efab-424e-ae7d-4e3d2ae05816 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:22.235181 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7b3d3a39-efab-424e-ae7d-4e3d2ae05816 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:22.241175 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b3d3a39-efab-424e-ae7d-4e3d2ae05816 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:22.241624 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b3d3a39-efab-424e-ae7d-4e3d2ae05816 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:22.242409 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b3d3a39-efab-424e-ae7d-4e3d2ae05816 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:22.242850 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b3d3a39-efab-424e-ae7d-4e3d2ae05816 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:22.373409 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1800670b-d166-4dda-a3b3-aeb4b88d482b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:22.374022 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1800670b-d166-4dda-a3b3-aeb4b88d482b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:22.375650 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7b3d3a39-efab-424e-ae7d-4e3d2ae05816 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:22.380447 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1800670b-d166-4dda-a3b3-aeb4b88d482b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:22.380898 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1800670b-d166-4dda-a3b3-aeb4b88d482b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:22.381661 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1800670b-d166-4dda-a3b3-aeb4b88d482b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:22.382093 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1800670b-d166-4dda-a3b3-aeb4b88d482b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:22.383508 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7b3d3a39-efab-424e-ae7d-4e3d2ae05816 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.153780 Apr 12 00:31:22.384115 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 355/684] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:22 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:22.508037 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1800670b-d166-4dda-a3b3-aeb4b88d482b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:22.516052 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1800670b-d166-4dda-a3b3-aeb4b88d482b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:22.517523 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1800670b-d166-4dda-a3b3-aeb4b88d482b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:22.518685 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1800670b-d166-4dda-a3b3-aeb4b88d482b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1794 microversion: 2.20 time: 0.149209 Apr 12 00:31:22.519272 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 330/685] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:31:22 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1794 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:31:23.399798 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c79cdb2f-3226-4867-902d-1f7746eccc19 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:23.400361 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c79cdb2f-3226-4867-902d-1f7746eccc19 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:23.406602 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c79cdb2f-3226-4867-902d-1f7746eccc19 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:23.407077 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c79cdb2f-3226-4867-902d-1f7746eccc19 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:23.407858 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c79cdb2f-3226-4867-902d-1f7746eccc19 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:23.408311 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c79cdb2f-3226-4867-902d-1f7746eccc19 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:23.542955 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-c79cdb2f-3226-4867-902d-1f7746eccc19 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:23.550114 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c79cdb2f-3226-4867-902d-1f7746eccc19 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1266 microversion: 2.1 time: 0.154663 Apr 12 00:31:23.550696 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 356/686] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:23 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:24.566681 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-607bfb7d-1bbd-473e-8cdd-296a2985f780 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:24.567292 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-607bfb7d-1bbd-473e-8cdd-296a2985f780 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:24.573867 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-607bfb7d-1bbd-473e-8cdd-296a2985f780 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:24.574331 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-607bfb7d-1bbd-473e-8cdd-296a2985f780 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:24.577385 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-607bfb7d-1bbd-473e-8cdd-296a2985f780 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:24.577385 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-607bfb7d-1bbd-473e-8cdd-296a2985f780 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:24.712221 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-607bfb7d-1bbd-473e-8cdd-296a2985f780 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:24.720166 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-607bfb7d-1bbd-473e-8cdd-296a2985f780 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1453 microversion: 2.1 time: 0.157286 Apr 12 00:31:24.720778 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 331/687] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:24 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:24.738917 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7a603997-0ba6-4f41-9207-cae29a4868c4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:24.738917 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7a603997-0ba6-4f41-9207-cae29a4868c4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:24.743837 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7a603997-0ba6-4f41-9207-cae29a4868c4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:24.744296 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7a603997-0ba6-4f41-9207-cae29a4868c4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:24.745038 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7a603997-0ba6-4f41-9207-cae29a4868c4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:24.745468 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7a603997-0ba6-4f41-9207-cae29a4868c4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:24.869441 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7a603997-0ba6-4f41-9207-cae29a4868c4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:24.876649 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7a603997-0ba6-4f41-9207-cae29a4868c4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1453 microversion: 2.1 time: 0.144020 Apr 12 00:31:24.877208 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 357/688] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:24 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:31:26.670845 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-8df45106-55c8-47f0-9998-34d4a25455cd req-f432c930-085f-4f21-b2b9-ed3f830fa5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e46194d7-3e05-4313-b0ca-4ec9cee517f8", "tag": "2ccdca9b-24da-4065-b499-5447b18262ad"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:26.678717 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-8df45106-55c8-47f0-9998-34d4a25455cd req-f432c930-085f-4f21-b2b9-ed3f830fa5e3 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:26.679158 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-8df45106-55c8-47f0-9998-34d4a25455cd req-f432c930-085f-4f21-b2b9-ed3f830fa5e3 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:26.690280 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-8df45106-55c8-47f0-9998-34d4a25455cd req-f432c930-085f-4f21-b2b9-ed3f830fa5e3 service nova] Creating event network-changed:2ccdca9b-24da-4065-b499-5447b18262ad for instance e46194d7-3e05-4313-b0ca-4ec9cee517f8 on hv-cinder-83625 Apr 12 00:31:26.695285 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-8df45106-55c8-47f0-9998-34d4a25455cd req-f432c930-085f-4f21-b2b9-ed3f830fa5e3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084661 Apr 12 00:31:26.696190 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 332/689] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:37.968162 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4914f407-6c9b-4a46-9161-4ad3bfdd3382 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcb0d9cc-8bc2-4e6b-9d54-271eff488ce0"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:37.969225 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4914f407-6c9b-4a46-9161-4ad3bfdd3382 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:37.976140 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4914f407-6c9b-4a46-9161-4ad3bfdd3382 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:37.976586 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4914f407-6c9b-4a46-9161-4ad3bfdd3382 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:37.977857 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4914f407-6c9b-4a46-9161-4ad3bfdd3382 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:37.978313 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4914f407-6c9b-4a46-9161-4ad3bfdd3382 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:38.223750 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4914f407-6c9b-4a46-9161-4ad3bfdd3382 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "POST /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.471178 Apr 12 00:31:38.224283 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 358/690] 10.222.0.32 () {60 vars in 1322 bytes} [Tue Apr 12 00:31:37 2022] POST /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/os-volume_attachments => generated 194 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:45.693276 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-00581cb9-d3c4-47ae-b9cf-71884c6f71cb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:45.694364 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-00581cb9-d3c4-47ae-b9cf-71884c6f71cb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:45.700371 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-00581cb9-d3c4-47ae-b9cf-71884c6f71cb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:45.700819 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-00581cb9-d3c4-47ae-b9cf-71884c6f71cb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:45.701580 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-00581cb9-d3c4-47ae-b9cf-71884c6f71cb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:45.702020 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-00581cb9-d3c4-47ae-b9cf-71884c6f71cb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:45.724279 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-00581cb9-d3c4-47ae-b9cf-71884c6f71cb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lazy-loading 'flavor' on Instance uuid 85a3e7dc-86c5-42ab-8a46-126c80dd1adc {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:31:45.846351 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-00581cb9-d3c4-47ae-b9cf-71884c6f71cb tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "POST /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/action" status: 200 len: 32 microversion: 2.1 time: 0.157876 Apr 12 00:31:45.847316 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 333/691] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Apr 12 00:31:45 2022] POST /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:31:45.857239 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1e7a0248-8609-4e6e-821a-efc160bd3956 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:45.859141 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1e7a0248-8609-4e6e-821a-efc160bd3956 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:45.867353 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1e7a0248-8609-4e6e-821a-efc160bd3956 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:45.868070 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1e7a0248-8609-4e6e-821a-efc160bd3956 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:45.869230 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1e7a0248-8609-4e6e-821a-efc160bd3956 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:45.869672 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1e7a0248-8609-4e6e-821a-efc160bd3956 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:46.003411 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1e7a0248-8609-4e6e-821a-efc160bd3956 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:46.011623 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1e7a0248-8609-4e6e-821a-efc160bd3956 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.158724 Apr 12 00:31:46.012194 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 359/692] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:45 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:47.030063 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-7d4f2374-4402-4468-be2f-008a02faf8a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:47.030852 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-7d4f2374-4402-4468-be2f-008a02faf8a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:47.037017 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7d4f2374-4402-4468-be2f-008a02faf8a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:47.037472 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7d4f2374-4402-4468-be2f-008a02faf8a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:47.038236 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7d4f2374-4402-4468-be2f-008a02faf8a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:47.038699 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7d4f2374-4402-4468-be2f-008a02faf8a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:47.163286 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-7d4f2374-4402-4468-be2f-008a02faf8a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:47.171641 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-7d4f2374-4402-4468-be2f-008a02faf8a1 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.146441 Apr 12 00:31:47.172215 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 334/693] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:47 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:48.189039 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e0478d0a-63b6-4c34-8b7d-b1ac8b042c3d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:48.189649 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e0478d0a-63b6-4c34-8b7d-b1ac8b042c3d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:48.196491 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e0478d0a-63b6-4c34-8b7d-b1ac8b042c3d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:48.196936 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e0478d0a-63b6-4c34-8b7d-b1ac8b042c3d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:48.197689 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e0478d0a-63b6-4c34-8b7d-b1ac8b042c3d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:48.198115 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e0478d0a-63b6-4c34-8b7d-b1ac8b042c3d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:48.321661 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e0478d0a-63b6-4c34-8b7d-b1ac8b042c3d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:48.329599 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e0478d0a-63b6-4c34-8b7d-b1ac8b042c3d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.144503 Apr 12 00:31:48.330163 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 360/694] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:48 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:49.346682 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a9210fad-5be8-4900-ae65-48ec8c69e712 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:49.347285 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a9210fad-5be8-4900-ae65-48ec8c69e712 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:49.353488 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a9210fad-5be8-4900-ae65-48ec8c69e712 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:49.353932 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a9210fad-5be8-4900-ae65-48ec8c69e712 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:49.354715 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a9210fad-5be8-4900-ae65-48ec8c69e712 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:49.355143 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a9210fad-5be8-4900-ae65-48ec8c69e712 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:49.482630 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a9210fad-5be8-4900-ae65-48ec8c69e712 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:49.490270 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a9210fad-5be8-4900-ae65-48ec8c69e712 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.147445 Apr 12 00:31:49.490836 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 335/695] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:49 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:50.507165 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-6f547fe6-8f14-4516-955d-dd1c73922af7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:50.507802 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-6f547fe6-8f14-4516-955d-dd1c73922af7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:50.514026 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6f547fe6-8f14-4516-955d-dd1c73922af7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:50.514500 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6f547fe6-8f14-4516-955d-dd1c73922af7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:50.515254 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6f547fe6-8f14-4516-955d-dd1c73922af7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:50.515685 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6f547fe6-8f14-4516-955d-dd1c73922af7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:50.638174 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-6f547fe6-8f14-4516-955d-dd1c73922af7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:50.646110 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-6f547fe6-8f14-4516-955d-dd1c73922af7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.142805 Apr 12 00:31:50.646696 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 361/696] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:50 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:51.663315 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3e62400a-9e9b-43d5-a385-ffb68e4f278b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:51.663878 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3e62400a-9e9b-43d5-a385-ffb68e4f278b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:51.670113 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3e62400a-9e9b-43d5-a385-ffb68e4f278b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:51.670600 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3e62400a-9e9b-43d5-a385-ffb68e4f278b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:51.671367 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3e62400a-9e9b-43d5-a385-ffb68e4f278b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:51.671804 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3e62400a-9e9b-43d5-a385-ffb68e4f278b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:51.795914 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-3e62400a-9e9b-43d5-a385-ffb68e4f278b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:51.803599 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3e62400a-9e9b-43d5-a385-ffb68e4f278b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.144238 Apr 12 00:31:51.804849 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 336/697] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:51 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:52.822273 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-cacbcbf5-a21b-40ae-b43e-a620174152c7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:52.822888 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-cacbcbf5-a21b-40ae-b43e-a620174152c7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:52.829188 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-cacbcbf5-a21b-40ae-b43e-a620174152c7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:52.829638 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-cacbcbf5-a21b-40ae-b43e-a620174152c7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:52.830427 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-cacbcbf5-a21b-40ae-b43e-a620174152c7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:52.830863 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-cacbcbf5-a21b-40ae-b43e-a620174152c7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:52.963006 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-cacbcbf5-a21b-40ae-b43e-a620174152c7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:52.970628 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-cacbcbf5-a21b-40ae-b43e-a620174152c7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.152814 Apr 12 00:31:52.971187 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 362/698] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:52 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:53.987632 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-8954a508-28ff-4f1f-8722-46c3a4e45d92 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:53.988255 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-8954a508-28ff-4f1f-8722-46c3a4e45d92 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:53.995103 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8954a508-28ff-4f1f-8722-46c3a4e45d92 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:53.995547 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8954a508-28ff-4f1f-8722-46c3a4e45d92 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:53.996298 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8954a508-28ff-4f1f-8722-46c3a4e45d92 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:53.996727 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8954a508-28ff-4f1f-8722-46c3a4e45d92 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:54.119832 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-8954a508-28ff-4f1f-8722-46c3a4e45d92 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:54.127808 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-8954a508-28ff-4f1f-8722-46c3a4e45d92 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.144056 Apr 12 00:31:54.128376 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 337/699] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:53 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:55.145105 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-250a33fb-08e7-4123-9ed4-93895f1341f7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:55.145712 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-250a33fb-08e7-4123-9ed4-93895f1341f7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:55.152695 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-250a33fb-08e7-4123-9ed4-93895f1341f7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:55.153144 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-250a33fb-08e7-4123-9ed4-93895f1341f7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:55.153905 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-250a33fb-08e7-4123-9ed4-93895f1341f7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:55.154367 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-250a33fb-08e7-4123-9ed4-93895f1341f7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:55.278601 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-250a33fb-08e7-4123-9ed4-93895f1341f7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:55.286273 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-250a33fb-08e7-4123-9ed4-93895f1341f7 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.145310 Apr 12 00:31:55.286845 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 363/700] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:55 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:56.302820 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1d38db28-0b09-49a9-97ea-5444ede2ff05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:56.303423 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1d38db28-0b09-49a9-97ea-5444ede2ff05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:56.310124 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1d38db28-0b09-49a9-97ea-5444ede2ff05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:56.310594 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1d38db28-0b09-49a9-97ea-5444ede2ff05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:56.311343 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1d38db28-0b09-49a9-97ea-5444ede2ff05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:56.311773 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1d38db28-0b09-49a9-97ea-5444ede2ff05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:56.438733 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1d38db28-0b09-49a9-97ea-5444ede2ff05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:56.447418 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1d38db28-0b09-49a9-97ea-5444ede2ff05 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.148377 Apr 12 00:31:56.447983 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 338/701] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:56 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:57.465122 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-24a024a5-3452-4206-850c-bc9ff44f759f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:57.465667 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-24a024a5-3452-4206-850c-bc9ff44f759f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:57.471960 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-24a024a5-3452-4206-850c-bc9ff44f759f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:57.472410 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-24a024a5-3452-4206-850c-bc9ff44f759f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:57.473173 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-24a024a5-3452-4206-850c-bc9ff44f759f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:57.473624 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-24a024a5-3452-4206-850c-bc9ff44f759f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:57.601563 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-24a024a5-3452-4206-850c-bc9ff44f759f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:57.609307 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-24a024a5-3452-4206-850c-bc9ff44f759f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.148676 Apr 12 00:31:57.609881 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 364/702] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:57 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:58.626798 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-dc388c83-2442-484c-b0bf-a6fe8ddc9b65 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:58.627408 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-dc388c83-2442-484c-b0bf-a6fe8ddc9b65 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:58.634168 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dc388c83-2442-484c-b0bf-a6fe8ddc9b65 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:58.634665 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dc388c83-2442-484c-b0bf-a6fe8ddc9b65 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:58.635433 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dc388c83-2442-484c-b0bf-a6fe8ddc9b65 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:58.635870 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dc388c83-2442-484c-b0bf-a6fe8ddc9b65 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:58.764114 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-dc388c83-2442-484c-b0bf-a6fe8ddc9b65 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:58.772093 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-dc388c83-2442-484c-b0bf-a6fe8ddc9b65 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.149226 Apr 12 00:31:58.772678 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 339/703] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:58 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:59.789481 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-23181aad-a627-4d76-a23b-6a04fd4f49dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:59.790122 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-23181aad-a627-4d76-a23b-6a04fd4f49dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:31:59.796435 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-23181aad-a627-4d76-a23b-6a04fd4f49dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:59.796862 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-23181aad-a627-4d76-a23b-6a04fd4f49dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:59.797618 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-23181aad-a627-4d76-a23b-6a04fd4f49dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:31:59.798047 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-23181aad-a627-4d76-a23b-6a04fd4f49dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:31:59.925139 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-23181aad-a627-4d76-a23b-6a04fd4f49dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:31:59.932719 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-23181aad-a627-4d76-a23b-6a04fd4f49dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.147602 Apr 12 00:31:59.933281 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 365/704] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:31:59 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:00.949566 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b27657f0-7470-49b6-a152-f177f2c5620b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:00.950172 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b27657f0-7470-49b6-a152-f177f2c5620b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:00.956398 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b27657f0-7470-49b6-a152-f177f2c5620b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:00.956861 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b27657f0-7470-49b6-a152-f177f2c5620b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:00.957607 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b27657f0-7470-49b6-a152-f177f2c5620b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:00.958035 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b27657f0-7470-49b6-a152-f177f2c5620b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:01.084642 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b27657f0-7470-49b6-a152-f177f2c5620b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:01.092892 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b27657f0-7470-49b6-a152-f177f2c5620b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.147156 Apr 12 00:32:01.093454 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 340/705] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:00 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:02.110504 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5653a113-1f07-4406-81b6-1389f63b71f8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:02.111113 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5653a113-1f07-4406-81b6-1389f63b71f8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:02.117685 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5653a113-1f07-4406-81b6-1389f63b71f8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:02.118244 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5653a113-1f07-4406-81b6-1389f63b71f8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:02.118985 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5653a113-1f07-4406-81b6-1389f63b71f8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:02.119417 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5653a113-1f07-4406-81b6-1389f63b71f8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:02.245893 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5653a113-1f07-4406-81b6-1389f63b71f8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:02.253655 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5653a113-1f07-4406-81b6-1389f63b71f8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.147259 Apr 12 00:32:02.254301 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 366/706] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:02 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:03.271688 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a242ca3f-88a4-495e-9c3c-e954202f0158 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:03.272294 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a242ca3f-88a4-495e-9c3c-e954202f0158 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:03.278572 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a242ca3f-88a4-495e-9c3c-e954202f0158 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:03.279017 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a242ca3f-88a4-495e-9c3c-e954202f0158 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:03.279770 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a242ca3f-88a4-495e-9c3c-e954202f0158 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:03.280196 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a242ca3f-88a4-495e-9c3c-e954202f0158 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:03.403972 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a242ca3f-88a4-495e-9c3c-e954202f0158 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:03.411799 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a242ca3f-88a4-495e-9c3c-e954202f0158 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.144203 Apr 12 00:32:03.412365 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 341/707] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:03 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:04.429335 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ca4a6716-8f17-4962-8561-338d976b5adf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:04.429938 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ca4a6716-8f17-4962-8561-338d976b5adf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:04.437384 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ca4a6716-8f17-4962-8561-338d976b5adf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:04.437847 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ca4a6716-8f17-4962-8561-338d976b5adf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:04.438650 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ca4a6716-8f17-4962-8561-338d976b5adf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:04.439082 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ca4a6716-8f17-4962-8561-338d976b5adf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:04.567314 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ca4a6716-8f17-4962-8561-338d976b5adf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:04.575053 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ca4a6716-8f17-4962-8561-338d976b5adf tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.149623 Apr 12 00:32:04.575612 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 367/708] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:04 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:05.591898 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a6a8c6bf-a46f-4a0c-8811-59e6bc7fbb5b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:05.592448 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a6a8c6bf-a46f-4a0c-8811-59e6bc7fbb5b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:05.598631 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a6a8c6bf-a46f-4a0c-8811-59e6bc7fbb5b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:05.599072 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a6a8c6bf-a46f-4a0c-8811-59e6bc7fbb5b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:05.599836 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a6a8c6bf-a46f-4a0c-8811-59e6bc7fbb5b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:05.600261 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a6a8c6bf-a46f-4a0c-8811-59e6bc7fbb5b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:05.731070 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a6a8c6bf-a46f-4a0c-8811-59e6bc7fbb5b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:05.738769 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a6a8c6bf-a46f-4a0c-8811-59e6bc7fbb5b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1735 microversion: 2.1 time: 0.150788 Apr 12 00:32:05.739340 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 342/709] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:05 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:06.755891 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-184ee839-c2e4-422f-b705-07f1c55ff48c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:06.756504 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-184ee839-c2e4-422f-b705-07f1c55ff48c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:06.763374 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-184ee839-c2e4-422f-b705-07f1c55ff48c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:06.763848 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-184ee839-c2e4-422f-b705-07f1c55ff48c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:06.764611 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-184ee839-c2e4-422f-b705-07f1c55ff48c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:06.765048 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-184ee839-c2e4-422f-b705-07f1c55ff48c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:06.887014 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-184ee839-c2e4-422f-b705-07f1c55ff48c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:06.894880 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-184ee839-c2e4-422f-b705-07f1c55ff48c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1715 microversion: 2.1 time: 0.142951 Apr 12 00:32:06.895471 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 368/710] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:06 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1715 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:06.950566 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4f86dc47-9e79-468b-982e-9e3678d8bd13 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:06.951066 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-4f86dc47-9e79-468b-982e-9e3678d8bd13 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:06.956866 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4f86dc47-9e79-468b-982e-9e3678d8bd13 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:06.957312 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4f86dc47-9e79-468b-982e-9e3678d8bd13 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:06.958067 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4f86dc47-9e79-468b-982e-9e3678d8bd13 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:06.958534 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4f86dc47-9e79-468b-982e-9e3678d8bd13 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:07.077152 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-4f86dc47-9e79-468b-982e-9e3678d8bd13 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] HTTP exception thrown: Cannot 'detach_volume' instance 85a3e7dc-86c5-42ab-8a46-126c80dd1adc while it is in vm_state rescued Apr 12 00:32:07.077747 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4f86dc47-9e79-468b-982e-9e3678d8bd13 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Returning 409 to user: Cannot 'detach_volume' instance 85a3e7dc-86c5-42ab-8a46-126c80dd1adc while it is in vm_state rescued {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:32:07.078615 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-4f86dc47-9e79-468b-982e-9e3678d8bd13 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "DELETE /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/os-volume_attachments/dcb0d9cc-8bc2-4e6b-9d54-271eff488ce0" status: 409 len: 152 microversion: 2.1 time: 0.132237 Apr 12 00:32:07.079162 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 343/711] 10.222.0.32 () {58 vars in 1415 bytes} [Tue Apr 12 00:32:06 2022] DELETE /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/os-volume_attachments/dcb0d9cc-8bc2-4e6b-9d54-271eff488ce0 => generated 152 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 00:32:07.088091 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-051c2ff5-f00c-4e14-a75e-20e2914babb5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:07.088649 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-051c2ff5-f00c-4e14-a75e-20e2914babb5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:07.094356 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-051c2ff5-f00c-4e14-a75e-20e2914babb5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:07.094810 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-051c2ff5-f00c-4e14-a75e-20e2914babb5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:07.095569 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-051c2ff5-f00c-4e14-a75e-20e2914babb5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:07.096007 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-051c2ff5-f00c-4e14-a75e-20e2914babb5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:07.158461 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-051c2ff5-f00c-4e14-a75e-20e2914babb5 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "POST /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/action" status: 202 len: 0 microversion: 2.1 time: 0.074583 Apr 12 00:32:07.159274 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 369/712] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Apr 12 00:32:07 2022] POST /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:32:07.168368 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c5078584-4da9-443b-928a-2db9b13732de tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:07.168982 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c5078584-4da9-443b-928a-2db9b13732de tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:07.175322 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c5078584-4da9-443b-928a-2db9b13732de tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:07.175866 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c5078584-4da9-443b-928a-2db9b13732de tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:07.176738 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c5078584-4da9-443b-928a-2db9b13732de tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:07.177285 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c5078584-4da9-443b-928a-2db9b13732de tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:07.386592 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c5078584-4da9-443b-928a-2db9b13732de tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:07.394749 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c5078584-4da9-443b-928a-2db9b13732de tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1723 microversion: 2.1 time: 0.231468 Apr 12 00:32:07.395512 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 344/713] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:07 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:08.414801 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1ef02a13-a589-4072-9b3a-86b123688b11 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:08.415510 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1ef02a13-a589-4072-9b3a-86b123688b11 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:08.421597 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1ef02a13-a589-4072-9b3a-86b123688b11 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:08.422051 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1ef02a13-a589-4072-9b3a-86b123688b11 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:08.422851 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1ef02a13-a589-4072-9b3a-86b123688b11 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:08.423295 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1ef02a13-a589-4072-9b3a-86b123688b11 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:08.551808 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1ef02a13-a589-4072-9b3a-86b123688b11 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:08.559491 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1ef02a13-a589-4072-9b3a-86b123688b11 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1723 microversion: 2.1 time: 0.151215 Apr 12 00:32:08.560065 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 370/714] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:08 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:09.576665 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d5039567-b4f4-4063-82bc-7efad9087fe6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:09.577228 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d5039567-b4f4-4063-82bc-7efad9087fe6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:09.583644 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d5039567-b4f4-4063-82bc-7efad9087fe6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:09.584088 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d5039567-b4f4-4063-82bc-7efad9087fe6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:09.585440 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d5039567-b4f4-4063-82bc-7efad9087fe6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:09.585879 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d5039567-b4f4-4063-82bc-7efad9087fe6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:09.713280 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d5039567-b4f4-4063-82bc-7efad9087fe6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:09.721320 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d5039567-b4f4-4063-82bc-7efad9087fe6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1723 microversion: 2.1 time: 0.148595 Apr 12 00:32:09.721882 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 345/715] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:09 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:10.738807 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0819974d-9124-446f-939f-733ea6cbd53a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:10.739420 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0819974d-9124-446f-939f-733ea6cbd53a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:10.746336 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0819974d-9124-446f-939f-733ea6cbd53a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:10.746792 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0819974d-9124-446f-939f-733ea6cbd53a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:10.747559 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0819974d-9124-446f-939f-733ea6cbd53a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:10.747997 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0819974d-9124-446f-939f-733ea6cbd53a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:10.871733 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0819974d-9124-446f-939f-733ea6cbd53a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:10.879641 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0819974d-9124-446f-939f-733ea6cbd53a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1729 microversion: 2.1 time: 0.144740 Apr 12 00:32:10.880276 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 371/716] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:10 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1729 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:10.896996 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a75076e1-cadb-43e3-9bdb-90c55b58527b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:10.898094 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a75076e1-cadb-43e3-9bdb-90c55b58527b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:10.904356 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a75076e1-cadb-43e3-9bdb-90c55b58527b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:10.904824 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a75076e1-cadb-43e3-9bdb-90c55b58527b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:10.905597 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a75076e1-cadb-43e3-9bdb-90c55b58527b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:10.906023 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a75076e1-cadb-43e3-9bdb-90c55b58527b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:10.980443 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a75076e1-cadb-43e3-9bdb-90c55b58527b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087472 Apr 12 00:32:10.981043 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 346/717] 10.222.0.32 () {58 vars in 1274 bytes} [Tue Apr 12 00:32:10 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:12.342350 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-ee881f65-19e2-41a8-a42b-eb7481754982 req-ca10f60d-f584-481d-979d-cd359275566d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a3e7dc-86c5-42ab-8a46-126c80dd1adc", "tag": "acbbc313-dcc4-4731-a931-77e1a5d10277"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:12.350710 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-ee881f65-19e2-41a8-a42b-eb7481754982 req-ca10f60d-f584-481d-979d-cd359275566d service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:12.351158 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-ee881f65-19e2-41a8-a42b-eb7481754982 req-ca10f60d-f584-481d-979d-cd359275566d service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:12.364405 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-ee881f65-19e2-41a8-a42b-eb7481754982 req-ca10f60d-f584-481d-979d-cd359275566d service nova] Creating event network-changed:acbbc313-dcc4-4731-a931-77e1a5d10277 for instance 85a3e7dc-86c5-42ab-8a46-126c80dd1adc on hv-cinder-83625 Apr 12 00:32:12.369289 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-ee881f65-19e2-41a8-a42b-eb7481754982 req-ca10f60d-f584-481d-979d-cd359275566d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091097 Apr 12 00:32:12.369886 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 372/718] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:14.383790 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-0460de02-3f50-4242-b156-e8c92b580d2a req-cc959a39-7b77-45c8-ae79-372077b8080b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a3e7dc-86c5-42ab-8a46-126c80dd1adc", "tag": "acbbc313-dcc4-4731-a931-77e1a5d10277"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:14.391568 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-0460de02-3f50-4242-b156-e8c92b580d2a req-cc959a39-7b77-45c8-ae79-372077b8080b service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:14.392004 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-0460de02-3f50-4242-b156-e8c92b580d2a req-cc959a39-7b77-45c8-ae79-372077b8080b service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:14.403545 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-0460de02-3f50-4242-b156-e8c92b580d2a req-cc959a39-7b77-45c8-ae79-372077b8080b service nova] Creating event network-changed:acbbc313-dcc4-4731-a931-77e1a5d10277 for instance 85a3e7dc-86c5-42ab-8a46-126c80dd1adc on hv-cinder-83625 Apr 12 00:32:14.408373 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-0460de02-3f50-4242-b156-e8c92b580d2a req-cc959a39-7b77-45c8-ae79-372077b8080b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028681 Apr 12 00:32:14.409149 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 347/719] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:19.017607 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b1c208e1-9b93-41a1-ba7f-e330cbca9f92 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:19.018670 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b1c208e1-9b93-41a1-ba7f-e330cbca9f92 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:19.025434 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b1c208e1-9b93-41a1-ba7f-e330cbca9f92 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:19.025887 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b1c208e1-9b93-41a1-ba7f-e330cbca9f92 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:19.026685 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b1c208e1-9b93-41a1-ba7f-e330cbca9f92 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:19.027130 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b1c208e1-9b93-41a1-ba7f-e330cbca9f92 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:19.103059 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-b1c208e1-9b93-41a1-ba7f-e330cbca9f92 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lazy-loading 'services' on Instance uuid 6812d1c1-9663-404e-a23f-db9a8dc7e766 {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:32:19.170942 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b1c208e1-9b93-41a1-ba7f-e330cbca9f92 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/os-volume_attachments/f52328bb-551f-445c-b22e-04eef6a2e067" status: 202 len: 0 microversion: 2.1 time: 0.157877 Apr 12 00:32:19.171523 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 373/720] 10.222.0.32 () {58 vars in 1415 bytes} [Tue Apr 12 00:32:19 2022] DELETE /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/os-volume_attachments/f52328bb-551f-445c-b22e-04eef6a2e067 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:32:20.286508 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-224ca024-4ab9-4009-a90d-4c4706f7429f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:20.292463 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-224ca024-4ab9-4009-a90d-4c4706f7429f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:20.292905 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-224ca024-4ab9-4009-a90d-4c4706f7429f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:20.314116 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-224ca024-4ab9-4009-a90d-4c4706f7429f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Going to try to stop instance {{(pid=128487) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 12 00:32:20.355531 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-224ca024-4ab9-4009-a90d-4c4706f7429f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "POST /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/action" status: 202 len: 0 microversion: 2.1 time: 0.073539 Apr 12 00:32:20.356151 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 348/721] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Apr 12 00:32:20 2022] POST /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:32:20.365148 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ae789c7a-1125-4ee4-9351-59720595a703 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:20.367077 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ae789c7a-1125-4ee4-9351-59720595a703 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:20.373890 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ae789c7a-1125-4ee4-9351-59720595a703 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:20.374375 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ae789c7a-1125-4ee4-9351-59720595a703 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:20.375150 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ae789c7a-1125-4ee4-9351-59720595a703 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:20.375591 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ae789c7a-1125-4ee4-9351-59720595a703 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:20.503204 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ae789c7a-1125-4ee4-9351-59720595a703 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:20.510539 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ae789c7a-1125-4ee4-9351-59720595a703 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1678 microversion: 2.1 time: 0.149991 Apr 12 00:32:20.511102 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 374/722] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:20 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:21.046032 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:32:21.046294 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: Tue Apr 12 00:32:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 00:32:21.528894 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b3b8c329-9380-4f62-83cf-f5169d11eefb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:21.529663 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b3b8c329-9380-4f62-83cf-f5169d11eefb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:21.536236 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b3b8c329-9380-4f62-83cf-f5169d11eefb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:21.536672 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b3b8c329-9380-4f62-83cf-f5169d11eefb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:21.537932 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b3b8c329-9380-4f62-83cf-f5169d11eefb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:21.538393 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b3b8c329-9380-4f62-83cf-f5169d11eefb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:21.666305 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b3b8c329-9380-4f62-83cf-f5169d11eefb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:21.673956 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b3b8c329-9380-4f62-83cf-f5169d11eefb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1678 microversion: 2.1 time: 0.149795 Apr 12 00:32:21.674545 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 349/723] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:21 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:22.690520 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-568b0bd6-ff37-4497-b293-228fb0ae894a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:22.691127 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-568b0bd6-ff37-4497-b293-228fb0ae894a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:22.698010 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-568b0bd6-ff37-4497-b293-228fb0ae894a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:22.698494 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-568b0bd6-ff37-4497-b293-228fb0ae894a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:22.699247 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-568b0bd6-ff37-4497-b293-228fb0ae894a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:22.699678 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-568b0bd6-ff37-4497-b293-228fb0ae894a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:22.823331 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-568b0bd6-ff37-4497-b293-228fb0ae894a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:22.830851 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-568b0bd6-ff37-4497-b293-228fb0ae894a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1678 microversion: 2.1 time: 0.144194 Apr 12 00:32:22.831412 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 375/724] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:22 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1678 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:23.849039 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9f3a57b9-65ca-418b-807e-85919a68d2f6 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:23.849649 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-9f3a57b9-65ca-418b-807e-85919a68d2f6 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:23.856004 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9f3a57b9-65ca-418b-807e-85919a68d2f6 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:23.856467 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9f3a57b9-65ca-418b-807e-85919a68d2f6 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:23.857241 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9f3a57b9-65ca-418b-807e-85919a68d2f6 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:23.857680 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9f3a57b9-65ca-418b-807e-85919a68d2f6 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:23.988933 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9f3a57b9-65ca-418b-807e-85919a68d2f6 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:23.996310 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9f3a57b9-65ca-418b-807e-85919a68d2f6 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1678 microversion: 2.1 time: 0.151292 Apr 12 00:32:23.996898 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 350/725] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:23 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:25.013933 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1a5decca-5af7-48c5-943b-37348a8e3961 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:25.014609 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1a5decca-5af7-48c5-943b-37348a8e3961 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:25.021081 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1a5decca-5af7-48c5-943b-37348a8e3961 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:25.021530 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1a5decca-5af7-48c5-943b-37348a8e3961 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:25.022357 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1a5decca-5af7-48c5-943b-37348a8e3961 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:25.022818 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1a5decca-5af7-48c5-943b-37348a8e3961 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:25.146597 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1a5decca-5af7-48c5-943b-37348a8e3961 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:25.153855 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1a5decca-5af7-48c5-943b-37348a8e3961 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1678 microversion: 2.1 time: 0.144213 Apr 12 00:32:25.154443 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 376/726] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:25 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1678 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:26.171213 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-faa293f4-6145-4882-ba46-cbdfdb1bc9fc tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:26.171865 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-faa293f4-6145-4882-ba46-cbdfdb1bc9fc tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:26.178588 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-faa293f4-6145-4882-ba46-cbdfdb1bc9fc tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:26.179032 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-faa293f4-6145-4882-ba46-cbdfdb1bc9fc tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:26.179781 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-faa293f4-6145-4882-ba46-cbdfdb1bc9fc tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:26.180208 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-faa293f4-6145-4882-ba46-cbdfdb1bc9fc tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:26.303043 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-faa293f4-6145-4882-ba46-cbdfdb1bc9fc tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:26.310419 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-faa293f4-6145-4882-ba46-cbdfdb1bc9fc tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1678 microversion: 2.1 time: 0.142917 Apr 12 00:32:26.311015 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 351/727] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:26 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1678 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:27.327909 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f51e6d70-9e3a-42ed-88ad-2125a3ec74e4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:27.328443 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f51e6d70-9e3a-42ed-88ad-2125a3ec74e4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:27.335317 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f51e6d70-9e3a-42ed-88ad-2125a3ec74e4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:27.335770 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f51e6d70-9e3a-42ed-88ad-2125a3ec74e4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:27.336538 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f51e6d70-9e3a-42ed-88ad-2125a3ec74e4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:27.336973 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f51e6d70-9e3a-42ed-88ad-2125a3ec74e4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:27.465164 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f51e6d70-9e3a-42ed-88ad-2125a3ec74e4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:27.472435 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f51e6d70-9e3a-42ed-88ad-2125a3ec74e4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1678 microversion: 2.1 time: 0.148472 Apr 12 00:32:27.473000 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 377/728] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:27 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:28.489359 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-382ba44f-6253-4baf-aba3-0712243bf24e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:28.489994 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-382ba44f-6253-4baf-aba3-0712243bf24e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:28.496455 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-382ba44f-6253-4baf-aba3-0712243bf24e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:28.496951 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-382ba44f-6253-4baf-aba3-0712243bf24e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:28.497730 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-382ba44f-6253-4baf-aba3-0712243bf24e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:28.498162 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-382ba44f-6253-4baf-aba3-0712243bf24e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:28.842679 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-382ba44f-6253-4baf-aba3-0712243bf24e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:28.850168 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-382ba44f-6253-4baf-aba3-0712243bf24e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1678 microversion: 2.1 time: 0.364884 Apr 12 00:32:28.850787 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 352/729] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:28 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1678 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:29.578484 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0fb660ab-2aa4-4985-a31a-7e4baf560549 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:29.579050 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0fb660ab-2aa4-4985-a31a-7e4baf560549 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:29.585611 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0fb660ab-2aa4-4985-a31a-7e4baf560549 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:29.586060 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0fb660ab-2aa4-4985-a31a-7e4baf560549 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:29.586857 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0fb660ab-2aa4-4985-a31a-7e4baf560549 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:29.587370 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0fb660ab-2aa4-4985-a31a-7e4baf560549 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:29.615476 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0fb660ab-2aa4-4985-a31a-7e4baf560549 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/os-volume_attachments/e9cdccdd-9093-4176-82f4-dcc3c57a1461" status: 200 len: 194 microversion: 2.20 time: 0.041126 Apr 12 00:32:29.616042 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 378/730] 10.222.0.32 () {60 vars in 1453 bytes} [Tue Apr 12 00:32:29 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/os-volume_attachments/e9cdccdd-9093-4176-82f4-dcc3c57a1461 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:32:29.678067 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-7a2d0436-7bc6-42a7-8bfc-48409e0b7a78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:29.678578 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-7a2d0436-7bc6-42a7-8bfc-48409e0b7a78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:29.684770 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7a2d0436-7bc6-42a7-8bfc-48409e0b7a78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:29.685211 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7a2d0436-7bc6-42a7-8bfc-48409e0b7a78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:29.685964 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7a2d0436-7bc6-42a7-8bfc-48409e0b7a78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:29.686418 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7a2d0436-7bc6-42a7-8bfc-48409e0b7a78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:29.764041 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-7a2d0436-7bc6-42a7-8bfc-48409e0b7a78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lazy-loading 'services' on Instance uuid 02c4e615-6c86-41a2-b6a5-19371b76e311 {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:32:29.868238 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-cb4f9425-0510-44bb-9bcb-4acafb46bdf9 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:29.868984 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-cb4f9425-0510-44bb-9bcb-4acafb46bdf9 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:29.875677 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-cb4f9425-0510-44bb-9bcb-4acafb46bdf9 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:29.876041 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-cb4f9425-0510-44bb-9bcb-4acafb46bdf9 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:29.876836 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-cb4f9425-0510-44bb-9bcb-4acafb46bdf9 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:29.877274 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-cb4f9425-0510-44bb-9bcb-4acafb46bdf9 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:30.011341 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-cb4f9425-0510-44bb-9bcb-4acafb46bdf9 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:30.019773 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-cb4f9425-0510-44bb-9bcb-4acafb46bdf9 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1678 microversion: 2.1 time: 0.156106 Apr 12 00:32:30.020435 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 379/731] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:29 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:32:30.035285 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-7a2d0436-7bc6-42a7-8bfc-48409e0b7a78 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "DELETE /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/os-volume_attachments/e9cdccdd-9093-4176-82f4-dcc3c57a1461" status: 202 len: 0 microversion: 2.20 time: 0.362205 Apr 12 00:32:30.035953 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 353/732] 10.222.0.32 () {60 vars in 1456 bytes} [Tue Apr 12 00:32:29 2022] DELETE /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/os-volume_attachments/e9cdccdd-9093-4176-82f4-dcc3c57a1461 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:32:30.044505 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a5e63495-cf4d-438d-80f4-470c52b361f7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:30.045512 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a5e63495-cf4d-438d-80f4-470c52b361f7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:30.051547 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a5e63495-cf4d-438d-80f4-470c52b361f7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:30.052283 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a5e63495-cf4d-438d-80f4-470c52b361f7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:30.053516 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a5e63495-cf4d-438d-80f4-470c52b361f7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:30.054071 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a5e63495-cf4d-438d-80f4-470c52b361f7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:30.085283 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a5e63495-cf4d-438d-80f4-470c52b361f7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044814 Apr 12 00:32:30.089597 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 380/733] 10.222.0.32 () {60 vars in 1342 bytes} [Tue Apr 12 00:32:30 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 00:32:31.038222 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c1c78044-5f0a-4522-a66a-3221e3dca26b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:31.039215 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c1c78044-5f0a-4522-a66a-3221e3dca26b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:31.046157 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c1c78044-5f0a-4522-a66a-3221e3dca26b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:31.046667 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c1c78044-5f0a-4522-a66a-3221e3dca26b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:31.047445 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c1c78044-5f0a-4522-a66a-3221e3dca26b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:31.047878 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c1c78044-5f0a-4522-a66a-3221e3dca26b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:31.100041 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-472a6dfa-3aca-4c90-8eb3-43990417fa72 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:31.100962 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-472a6dfa-3aca-4c90-8eb3-43990417fa72 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:31.109009 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-472a6dfa-3aca-4c90-8eb3-43990417fa72 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:31.109472 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-472a6dfa-3aca-4c90-8eb3-43990417fa72 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:31.111117 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-472a6dfa-3aca-4c90-8eb3-43990417fa72 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:31.111581 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-472a6dfa-3aca-4c90-8eb3-43990417fa72 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:31.145998 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-472a6dfa-3aca-4c90-8eb3-43990417fa72 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050559 Apr 12 00:32:31.146633 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 381/734] 10.222.0.32 () {60 vars in 1342 bytes} [Tue Apr 12 00:32:31 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:32:31.186470 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c1c78044-5f0a-4522-a66a-3221e3dca26b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:31.193744 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c1c78044-5f0a-4522-a66a-3221e3dca26b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1678 microversion: 2.1 time: 0.160593 Apr 12 00:32:31.194303 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 354/735] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:31 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:31.204507 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3729b6aa-b196-45f5-8689-c10a237b298a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:31.205034 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3729b6aa-b196-45f5-8689-c10a237b298a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:31.211009 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3729b6aa-b196-45f5-8689-c10a237b298a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:31.211452 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3729b6aa-b196-45f5-8689-c10a237b298a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:31.212206 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3729b6aa-b196-45f5-8689-c10a237b298a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:31.212635 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3729b6aa-b196-45f5-8689-c10a237b298a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:31.236188 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3729b6aa-b196-45f5-8689-c10a237b298a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Going to try to terminate instance {{(pid=128486) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:32:31.309271 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3729b6aa-b196-45f5-8689-c10a237b298a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "DELETE /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 204 len: 0 microversion: 2.20 time: 0.108421 Apr 12 00:32:31.309838 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 382/736] 10.222.0.32 () {60 vars in 1279 bytes} [Tue Apr 12 00:32:31 2022] DELETE /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 00:32:31.318853 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c68b0f64-40a6-457f-8afa-6e0e0b6e3228 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:31.319558 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c68b0f64-40a6-457f-8afa-6e0e0b6e3228 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:31.325445 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c68b0f64-40a6-457f-8afa-6e0e0b6e3228 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:31.325891 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c68b0f64-40a6-457f-8afa-6e0e0b6e3228 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:31.326676 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c68b0f64-40a6-457f-8afa-6e0e0b6e3228 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:31.327107 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c68b0f64-40a6-457f-8afa-6e0e0b6e3228 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:31.457362 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c68b0f64-40a6-457f-8afa-6e0e0b6e3228 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:31.466198 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c68b0f64-40a6-457f-8afa-6e0e0b6e3228 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:31.468176 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c68b0f64-40a6-457f-8afa-6e0e0b6e3228 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:31.469587 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c68b0f64-40a6-457f-8afa-6e0e0b6e3228 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1722 microversion: 2.20 time: 0.154737 Apr 12 00:32:31.470488 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 355/737] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:32:31 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:32.211323 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7f52591b-0155-4d49-aecc-d226df188e03 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:32.212011 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7f52591b-0155-4d49-aecc-d226df188e03 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:32.218238 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7f52591b-0155-4d49-aecc-d226df188e03 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:32.218779 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7f52591b-0155-4d49-aecc-d226df188e03 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:32.219594 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7f52591b-0155-4d49-aecc-d226df188e03 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:32.220046 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7f52591b-0155-4d49-aecc-d226df188e03 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:32.350501 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7f52591b-0155-4d49-aecc-d226df188e03 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:32.357703 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7f52591b-0155-4d49-aecc-d226df188e03 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1678 microversion: 2.1 time: 0.150924 Apr 12 00:32:32.358303 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 383/738] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:32 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:32.489139 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-16f68340-3486-4c7d-b77d-592aa4f5d625 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:32.489697 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-16f68340-3486-4c7d-b77d-592aa4f5d625 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:32.496573 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-16f68340-3486-4c7d-b77d-592aa4f5d625 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:32.497036 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-16f68340-3486-4c7d-b77d-592aa4f5d625 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:32.497775 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-16f68340-3486-4c7d-b77d-592aa4f5d625 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:32.498206 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-16f68340-3486-4c7d-b77d-592aa4f5d625 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:32.624269 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-16f68340-3486-4c7d-b77d-592aa4f5d625 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:32.632059 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-16f68340-3486-4c7d-b77d-592aa4f5d625 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:32.633550 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-16f68340-3486-4c7d-b77d-592aa4f5d625 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:32.634706 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-16f68340-3486-4c7d-b77d-592aa4f5d625 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1722 microversion: 2.20 time: 0.149633 Apr 12 00:32:32.635258 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 356/739] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:32:32 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:33.375548 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e883d625-2203-4341-8e6c-45c21840b20e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:33.376146 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e883d625-2203-4341-8e6c-45c21840b20e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:33.382353 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e883d625-2203-4341-8e6c-45c21840b20e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:33.382802 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e883d625-2203-4341-8e6c-45c21840b20e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:33.383563 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e883d625-2203-4341-8e6c-45c21840b20e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:33.383995 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e883d625-2203-4341-8e6c-45c21840b20e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:33.514134 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e883d625-2203-4341-8e6c-45c21840b20e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:33.521893 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e883d625-2203-4341-8e6c-45c21840b20e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1678 microversion: 2.1 time: 0.150245 Apr 12 00:32:33.522628 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 384/740] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:33 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:33.653559 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-86364726-9dc2-4a09-93b3-572d5a595542 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:33.654159 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-86364726-9dc2-4a09-93b3-572d5a595542 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:33.668949 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-86364726-9dc2-4a09-93b3-572d5a595542 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:33.669224 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-86364726-9dc2-4a09-93b3-572d5a595542 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:33.670025 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-86364726-9dc2-4a09-93b3-572d5a595542 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:33.670508 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-86364726-9dc2-4a09-93b3-572d5a595542 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:33.894186 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-86364726-9dc2-4a09-93b3-572d5a595542 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:33.902028 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-86364726-9dc2-4a09-93b3-572d5a595542 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:33.903794 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-86364726-9dc2-4a09-93b3-572d5a595542 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:33.904883 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-86364726-9dc2-4a09-93b3-572d5a595542 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1722 microversion: 2.20 time: 0.255343 Apr 12 00:32:33.905435 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 357/741] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:32:33 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:34.346747 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-6396d69b-d520-4c1a-876e-5b815aa7aa19 req-76601291-9de3-41b7-a8c6-889a1700af9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c4e615-6c86-41a2-b6a5-19371b76e311", "name": "network-vif-deleted", "tag": "a96b86a8-a90d-426f-9b7e-b2dc136b138a"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:34.358314 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-6396d69b-d520-4c1a-876e-5b815aa7aa19 req-76601291-9de3-41b7-a8c6-889a1700af9e service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:34.358777 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-6396d69b-d520-4c1a-876e-5b815aa7aa19 req-76601291-9de3-41b7-a8c6-889a1700af9e service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:34.369895 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-6396d69b-d520-4c1a-876e-5b815aa7aa19 req-76601291-9de3-41b7-a8c6-889a1700af9e service nova] Creating event network-vif-deleted:a96b86a8-a90d-426f-9b7e-b2dc136b138a for instance 02c4e615-6c86-41a2-b6a5-19371b76e311 on hv-cinder-83625 Apr 12 00:32:34.375392 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-6396d69b-d520-4c1a-876e-5b815aa7aa19 req-76601291-9de3-41b7-a8c6-889a1700af9e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033067 Apr 12 00:32:34.376090 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 385/742] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:34.540115 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-71c42de4-7bc3-4d2b-b233-59d46b3fe898 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:34.540834 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-71c42de4-7bc3-4d2b-b233-59d46b3fe898 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:34.546895 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71c42de4-7bc3-4d2b-b233-59d46b3fe898 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:34.547439 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71c42de4-7bc3-4d2b-b233-59d46b3fe898 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:34.548310 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71c42de4-7bc3-4d2b-b233-59d46b3fe898 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:34.548838 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71c42de4-7bc3-4d2b-b233-59d46b3fe898 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:34.692895 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-71c42de4-7bc3-4d2b-b233-59d46b3fe898 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:34.700614 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-71c42de4-7bc3-4d2b-b233-59d46b3fe898 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1678 microversion: 2.1 time: 0.164499 Apr 12 00:32:34.701275 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 358/743] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:34 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:34.925984 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7b18353c-f7f3-47f1-b0d0-8e9f8e71b0d1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:34.927114 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7b18353c-f7f3-47f1-b0d0-8e9f8e71b0d1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:34.934511 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b18353c-f7f3-47f1-b0d0-8e9f8e71b0d1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:34.935364 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b18353c-f7f3-47f1-b0d0-8e9f8e71b0d1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:34.936406 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b18353c-f7f3-47f1-b0d0-8e9f8e71b0d1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:34.936731 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b18353c-f7f3-47f1-b0d0-8e9f8e71b0d1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:34.974810 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b18353c-f7f3-47f1-b0d0-8e9f8e71b0d1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:34.975290 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b18353c-f7f3-47f1-b0d0-8e9f8e71b0d1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:34.975751 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-7b18353c-f7f3-47f1-b0d0-8e9f8e71b0d1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lazy-loading 'fault' on Instance uuid 02c4e615-6c86-41a2-b6a5-19371b76e311 {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:32:35.019969 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7b18353c-f7f3-47f1-b0d0-8e9f8e71b0d1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:35.028481 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7b18353c-f7f3-47f1-b0d0-8e9f8e71b0d1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:35.030543 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7b18353c-f7f3-47f1-b0d0-8e9f8e71b0d1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:35.031814 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7b18353c-f7f3-47f1-b0d0-8e9f8e71b0d1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 200 len: 1370 microversion: 2.20 time: 0.111822 Apr 12 00:32:35.032689 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 386/744] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:32:34 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 1370 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:35.718460 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-0a4904c5-46e6-4285-8eeb-c57f1c4d8b0e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:35.719055 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-0a4904c5-46e6-4285-8eeb-c57f1c4d8b0e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:35.725810 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0a4904c5-46e6-4285-8eeb-c57f1c4d8b0e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:35.726272 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0a4904c5-46e6-4285-8eeb-c57f1c4d8b0e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:35.727038 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0a4904c5-46e6-4285-8eeb-c57f1c4d8b0e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:35.727465 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0a4904c5-46e6-4285-8eeb-c57f1c4d8b0e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:35.861342 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-0a4904c5-46e6-4285-8eeb-c57f1c4d8b0e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:35.869268 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-0a4904c5-46e6-4285-8eeb-c57f1c4d8b0e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1678 microversion: 2.1 time: 0.154704 Apr 12 00:32:35.869843 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 359/745] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:35 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:36.050537 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f84dbdd5-9391-4be8-9a06-f9923bf9d5a3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:36.051279 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f84dbdd5-9391-4be8-9a06-f9923bf9d5a3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:36.059142 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f84dbdd5-9391-4be8-9a06-f9923bf9d5a3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:36.059663 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f84dbdd5-9391-4be8-9a06-f9923bf9d5a3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:36.060585 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f84dbdd5-9391-4be8-9a06-f9923bf9d5a3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:36.061076 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f84dbdd5-9391-4be8-9a06-f9923bf9d5a3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:36.075728 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-f84dbdd5-9391-4be8-9a06-f9923bf9d5a3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] HTTP exception thrown: Instance 02c4e615-6c86-41a2-b6a5-19371b76e311 could not be found. Apr 12 00:32:36.076311 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f84dbdd5-9391-4be8-9a06-f9923bf9d5a3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Returning 404 to user: Instance 02c4e615-6c86-41a2-b6a5-19371b76e311 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:32:36.077153 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f84dbdd5-9391-4be8-9a06-f9923bf9d5a3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 404 len: 111 microversion: 2.20 time: 0.030642 Apr 12 00:32:36.077684 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 387/746] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:32:36 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 12 00:32:36.086653 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-dc7f1fb1-e27b-4736-b26e-79113d468408 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '.version_select at 0x7f64e12dd160>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:36.108158 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-dc7f1fb1-e27b-4736-b26e-79113d468408 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-675333121" status: 204 len: 0 microversion: 2.20 time: 0.025821 Apr 12 00:32:36.108952 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 360/747] 10.222.0.32 () {60 vars in 1258 bytes} [Tue Apr 12 00:32:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-675333121 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 00:32:36.783110 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-28b84bb8-5347-4591-a967-ed5a80639bbb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Action: 'create', calling method: .version_select at 0x7f64e13f8af0>, body: {"keypair": {"name": "tempest-keypair-1976025183"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:36.796565 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-28b84bb8-5347-4591-a967-ed5a80639bbb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Getting quotas for project 8b482c4c00e94a25ad8f0a9034e9e0e5. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:32:36.800245 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-28b84bb8-5347-4591-a967-ed5a80639bbb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Getting quotas for user f0fad81c4cbd4335967e97fd7de9963d and project 8b482c4c00e94a25ad8f0a9034e9e0e5. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:32:36.886742 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3e225e96-10b0-4be4-93f8-7f59d08c4963 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:36.887960 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3e225e96-10b0-4be4-93f8-7f59d08c4963 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:36.894883 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3e225e96-10b0-4be4-93f8-7f59d08c4963 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:36.895273 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3e225e96-10b0-4be4-93f8-7f59d08c4963 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:36.896072 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3e225e96-10b0-4be4-93f8-7f59d08c4963 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:36.896512 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3e225e96-10b0-4be4-93f8-7f59d08c4963 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:36.973371 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-28b84bb8-5347-4591-a967-ed5a80639bbb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Getting quotas for project 8b482c4c00e94a25ad8f0a9034e9e0e5. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:32:36.977813 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-28b84bb8-5347-4591-a967-ed5a80639bbb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Getting quotas for user f0fad81c4cbd4335967e97fd7de9963d and project 8b482c4c00e94a25ad8f0a9034e9e0e5. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:32:36.992382 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-28b84bb8-5347-4591-a967-ed5a80639bbb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.213195 Apr 12 00:32:36.993581 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 388/748] 10.222.0.32 () {62 vars in 1198 bytes} [Tue Apr 12 00:32:36 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 214 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 12 00:32:37.039574 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-3e225e96-10b0-4be4-93f8-7f59d08c4963 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:37.048090 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3e225e96-10b0-4be4-93f8-7f59d08c4963 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1655 microversion: 2.1 time: 0.165600 Apr 12 00:32:37.049009 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 361/749] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:36 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1655 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:32:37.065138 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0a495d65-1913-481b-8c75-3c5bad8a17f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:37.074990 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0a495d65-1913-481b-8c75-3c5bad8a17f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:37.075731 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0a495d65-1913-481b-8c75-3c5bad8a17f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:37.100238 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0a495d65-1913-481b-8c75-3c5bad8a17f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Going to try to start instance {{(pid=128486) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 12 00:32:37.150581 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0a495d65-1913-481b-8c75-3c5bad8a17f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "POST /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/action" status: 202 len: 0 microversion: 2.1 time: 0.089001 Apr 12 00:32:37.151862 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 389/750] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Apr 12 00:32:37 2022] POST /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:32:37.159772 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-50cca6eb-f794-44c5-9161-3e9e4b4c1a6e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:37.160380 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-50cca6eb-f794-44c5-9161-3e9e4b4c1a6e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:37.167215 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-50cca6eb-f794-44c5-9161-3e9e4b4c1a6e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:37.167769 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-50cca6eb-f794-44c5-9161-3e9e4b4c1a6e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:37.168584 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-50cca6eb-f794-44c5-9161-3e9e4b4c1a6e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:37.169003 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-50cca6eb-f794-44c5-9161-3e9e4b4c1a6e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:37.456667 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-50cca6eb-f794-44c5-9161-3e9e4b4c1a6e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:37.465337 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-50cca6eb-f794-44c5-9161-3e9e4b4c1a6e tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1664 microversion: 2.1 time: 0.309332 Apr 12 00:32:37.469169 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 362/751] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:37 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1664 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:38.484013 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0956f7f8-2598-45a4-886b-7bb57a576f90 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:38.484824 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0956f7f8-2598-45a4-886b-7bb57a576f90 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:38.490929 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0956f7f8-2598-45a4-886b-7bb57a576f90 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:38.491385 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0956f7f8-2598-45a4-886b-7bb57a576f90 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:38.492358 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0956f7f8-2598-45a4-886b-7bb57a576f90 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:38.492795 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0956f7f8-2598-45a4-886b-7bb57a576f90 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:38.673370 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0956f7f8-2598-45a4-886b-7bb57a576f90 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:38.681645 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0956f7f8-2598-45a4-886b-7bb57a576f90 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1664 microversion: 2.1 time: 0.202056 Apr 12 00:32:38.682226 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 390/752] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:38 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1664 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:38.733618 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5d7996fa-464c-4405-b3f6-ec1edabeb490 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1648714108", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ee4ba18-669f-44db-9087-b0bd886e30c9"}], "security_groups": [{"name": "tempest-securitygroup--1107101977"}], "key_name": "tempest-keypair-1976025183", "user_data": "}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:38.834885 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.network.neutron [None req-5d7996fa-464c-4405-b3f6-ec1edabeb490 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] validate_networks() for [('1ee4ba18-669f-44db-9087-b0bd886e30c9', None, None, None, None, None)] {{(pid=128487) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:32:39.296368 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-5d7996fa-464c-4405-b3f6-ec1edabeb490 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Flavor limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:32:39.296861 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-5d7996fa-464c-4405-b3f6-ec1edabeb490 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Image limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:32:39.297328 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-5d7996fa-464c-4405-b3f6-ec1edabeb490 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Flavor pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:32:39.297776 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-5d7996fa-464c-4405-b3f6-ec1edabeb490 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Image pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:32:39.298158 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-5d7996fa-464c-4405-b3f6-ec1edabeb490 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:32:39.307246 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5d7996fa-464c-4405-b3f6-ec1edabeb490 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:39.307690 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5d7996fa-464c-4405-b3f6-ec1edabeb490 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:39.308514 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5d7996fa-464c-4405-b3f6-ec1edabeb490 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:39.308952 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5d7996fa-464c-4405-b3f6-ec1edabeb490 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:39.324819 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-5d7996fa-464c-4405-b3f6-ec1edabeb490 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Getting quotas for project 8b482c4c00e94a25ad8f0a9034e9e0e5. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:32:39.328626 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-5d7996fa-464c-4405-b3f6-ec1edabeb490 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Getting quotas for user f0fad81c4cbd4335967e97fd7de9963d and project 8b482c4c00e94a25ad8f0a9034e9e0e5. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:32:39.339425 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5d7996fa-464c-4405-b3f6-ec1edabeb490 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Going to run 1 instances... {{(pid=128487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:32:39.341742 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5d7996fa-464c-4405-b3f6-ec1edabeb490 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:32:39.388695 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5d7996fa-464c-4405-b3f6-ec1edabeb490 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.659380 Apr 12 00:32:39.389354 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 363/753] 10.222.0.32 () {62 vars in 1187 bytes} [Tue Apr 12 00:32:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 12 00:32:39.399511 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-53738fa4-1fac-4889-b31c-cf769abd98e9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:39.400109 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-53738fa4-1fac-4889-b31c-cf769abd98e9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:39.454731 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-53738fa4-1fac-4889-b31c-cf769abd98e9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:39.461655 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-53738fa4-1fac-4889-b31c-cf769abd98e9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:39.463185 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-53738fa4-1fac-4889-b31c-cf769abd98e9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:39.464278 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-53738fa4-1fac-4889-b31c-cf769abd98e9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1282 microversion: 2.20 time: 0.068691 Apr 12 00:32:39.464844 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 391/754] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:32:39 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1282 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:39.699578 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-cf9094b5-2f66-409a-922b-a21b5e2dbdcd tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:39.700222 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-cf9094b5-2f66-409a-922b-a21b5e2dbdcd tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:39.706783 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cf9094b5-2f66-409a-922b-a21b5e2dbdcd tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:39.707227 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cf9094b5-2f66-409a-922b-a21b5e2dbdcd tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:39.708001 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cf9094b5-2f66-409a-922b-a21b5e2dbdcd tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:39.708433 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cf9094b5-2f66-409a-922b-a21b5e2dbdcd tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:39.845827 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-cf9094b5-2f66-409a-922b-a21b5e2dbdcd tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:39.853290 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-cf9094b5-2f66-409a-922b-a21b5e2dbdcd tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1668 microversion: 2.1 time: 0.158186 Apr 12 00:32:39.853887 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 364/755] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:32:39 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:40.482722 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-459aa444-41ab-4797-9b39-f80ed47d1383 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:40.483331 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-459aa444-41ab-4797-9b39-f80ed47d1383 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:40.490856 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-459aa444-41ab-4797-9b39-f80ed47d1383 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:40.491308 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-459aa444-41ab-4797-9b39-f80ed47d1383 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:40.492082 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-459aa444-41ab-4797-9b39-f80ed47d1383 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:40.492520 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-459aa444-41ab-4797-9b39-f80ed47d1383 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:40.560330 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-459aa444-41ab-4797-9b39-f80ed47d1383 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:40.569178 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-459aa444-41ab-4797-9b39-f80ed47d1383 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:40.570731 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-459aa444-41ab-4797-9b39-f80ed47d1383 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:40.571852 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-459aa444-41ab-4797-9b39-f80ed47d1383 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1342 microversion: 2.20 time: 0.093056 Apr 12 00:32:40.572408 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 392/756] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:32:40 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1342 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:41.589660 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f6f51c14-12cc-4b5b-9c44-c2fc06e0d486 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:41.590288 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f6f51c14-12cc-4b5b-9c44-c2fc06e0d486 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:41.596430 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f6f51c14-12cc-4b5b-9c44-c2fc06e0d486 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:41.596873 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f6f51c14-12cc-4b5b-9c44-c2fc06e0d486 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:41.597634 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f6f51c14-12cc-4b5b-9c44-c2fc06e0d486 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:41.598065 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f6f51c14-12cc-4b5b-9c44-c2fc06e0d486 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:41.809328 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f6f51c14-12cc-4b5b-9c44-c2fc06e0d486 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:41.818467 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f6f51c14-12cc-4b5b-9c44-c2fc06e0d486 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:41.820382 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f6f51c14-12cc-4b5b-9c44-c2fc06e0d486 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:41.821801 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f6f51c14-12cc-4b5b-9c44-c2fc06e0d486 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1408 microversion: 2.20 time: 0.236102 Apr 12 00:32:41.822439 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 365/757] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:32:41 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:32:42.015284 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-d5cc739e-0d99-4437-bf04-50bc08a6be64 req-2945264a-1ea0-40ef-bd1a-e17073ab3be0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fd000ee-5205-4d02-b7a8-8c99871c8f29", "tag": "0e9155b9-7112-41cd-b8ec-dd359b342b3a"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:42.033542 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-d5cc739e-0d99-4437-bf04-50bc08a6be64 req-2945264a-1ea0-40ef-bd1a-e17073ab3be0 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:42.033914 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-d5cc739e-0d99-4437-bf04-50bc08a6be64 req-2945264a-1ea0-40ef-bd1a-e17073ab3be0 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:42.046876 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-d5cc739e-0d99-4437-bf04-50bc08a6be64 req-2945264a-1ea0-40ef-bd1a-e17073ab3be0 service nova] Creating event network-changed:0e9155b9-7112-41cd-b8ec-dd359b342b3a for instance 6fd000ee-5205-4d02-b7a8-8c99871c8f29 on hv-cinder-83625 Apr 12 00:32:42.053641 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-d5cc739e-0d99-4437-bf04-50bc08a6be64 req-2945264a-1ea0-40ef-bd1a-e17073ab3be0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043197 Apr 12 00:32:42.055111 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 393/758] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:42.840626 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-63916ce0-8a8c-4ca7-ab48-6197eabb8fb3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:42.841224 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-63916ce0-8a8c-4ca7-ab48-6197eabb8fb3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:42.847663 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-63916ce0-8a8c-4ca7-ab48-6197eabb8fb3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:42.848114 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-63916ce0-8a8c-4ca7-ab48-6197eabb8fb3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:42.848952 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-63916ce0-8a8c-4ca7-ab48-6197eabb8fb3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:42.849339 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-63916ce0-8a8c-4ca7-ab48-6197eabb8fb3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:42.972774 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-63916ce0-8a8c-4ca7-ab48-6197eabb8fb3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:42.980881 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-63916ce0-8a8c-4ca7-ab48-6197eabb8fb3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:42.982484 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-63916ce0-8a8c-4ca7-ab48-6197eabb8fb3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:42.983575 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-63916ce0-8a8c-4ca7-ab48-6197eabb8fb3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1408 microversion: 2.20 time: 0.146868 Apr 12 00:32:42.984123 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 366/759] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:32:42 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1408 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:44.003501 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-944b3558-b6b4-4d92-acdc-9b2fa0cc2c08 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:44.004273 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-944b3558-b6b4-4d92-acdc-9b2fa0cc2c08 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:44.011156 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-944b3558-b6b4-4d92-acdc-9b2fa0cc2c08 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:44.011613 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-944b3558-b6b4-4d92-acdc-9b2fa0cc2c08 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:44.012382 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-944b3558-b6b4-4d92-acdc-9b2fa0cc2c08 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:44.012844 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-944b3558-b6b4-4d92-acdc-9b2fa0cc2c08 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:44.141117 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-944b3558-b6b4-4d92-acdc-9b2fa0cc2c08 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:44.149376 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-944b3558-b6b4-4d92-acdc-9b2fa0cc2c08 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:44.151021 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-944b3558-b6b4-4d92-acdc-9b2fa0cc2c08 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:44.152140 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-944b3558-b6b4-4d92-acdc-9b2fa0cc2c08 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1408 microversion: 2.20 time: 0.153611 Apr 12 00:32:44.152706 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 394/760] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:32:43 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:45.170330 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-891a2314-fa3c-48d5-9f88-228d06be5f07 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:45.170940 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-891a2314-fa3c-48d5-9f88-228d06be5f07 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:45.177716 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-891a2314-fa3c-48d5-9f88-228d06be5f07 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:45.178164 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-891a2314-fa3c-48d5-9f88-228d06be5f07 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:45.179064 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-891a2314-fa3c-48d5-9f88-228d06be5f07 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:45.179499 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-891a2314-fa3c-48d5-9f88-228d06be5f07 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:45.370112 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-891a2314-fa3c-48d5-9f88-228d06be5f07 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:45.378696 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-891a2314-fa3c-48d5-9f88-228d06be5f07 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:45.384437 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-891a2314-fa3c-48d5-9f88-228d06be5f07 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:45.385649 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-891a2314-fa3c-48d5-9f88-228d06be5f07 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1408 microversion: 2.20 time: 0.219248 Apr 12 00:32:45.386321 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 367/761] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:32:45 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:46.404139 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-87d58137-9a26-45d9-848e-0ecf5bc1cf46 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:46.404662 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-87d58137-9a26-45d9-848e-0ecf5bc1cf46 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:46.411016 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-87d58137-9a26-45d9-848e-0ecf5bc1cf46 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:46.412120 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-87d58137-9a26-45d9-848e-0ecf5bc1cf46 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:46.412827 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-87d58137-9a26-45d9-848e-0ecf5bc1cf46 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:46.413260 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-87d58137-9a26-45d9-848e-0ecf5bc1cf46 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:46.539835 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-87d58137-9a26-45d9-848e-0ecf5bc1cf46 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:46.547539 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-87d58137-9a26-45d9-848e-0ecf5bc1cf46 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:46.549033 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-87d58137-9a26-45d9-848e-0ecf5bc1cf46 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:46.550113 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-87d58137-9a26-45d9-848e-0ecf5bc1cf46 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1408 microversion: 2.20 time: 0.149959 Apr 12 00:32:46.550698 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 395/762] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:32:46 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:47.530723 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-045c55ed-976a-4a53-888d-be7a340dff8e req-4e619780-7c20-4b20-bda0-7ca944c1aacd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd000ee-5205-4d02-b7a8-8c99871c8f29", "name": "network-vif-plugged", "status": "completed", "tag": "0e9155b9-7112-41cd-b8ec-dd359b342b3a"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:47.540240 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-045c55ed-976a-4a53-888d-be7a340dff8e req-4e619780-7c20-4b20-bda0-7ca944c1aacd service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:47.540688 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-045c55ed-976a-4a53-888d-be7a340dff8e req-4e619780-7c20-4b20-bda0-7ca944c1aacd service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:47.551618 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-045c55ed-976a-4a53-888d-be7a340dff8e req-4e619780-7c20-4b20-bda0-7ca944c1aacd service nova] Creating event network-vif-plugged:0e9155b9-7112-41cd-b8ec-dd359b342b3a for instance 6fd000ee-5205-4d02-b7a8-8c99871c8f29 on hv-cinder-83625 Apr 12 00:32:47.557236 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-045c55ed-976a-4a53-888d-be7a340dff8e req-4e619780-7c20-4b20-bda0-7ca944c1aacd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030213 Apr 12 00:32:47.557836 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 368/763] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:47.568068 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-174054e0-3c1f-48d7-b898-6c5b9df39954 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:47.568595 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-174054e0-3c1f-48d7-b898-6c5b9df39954 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:47.574962 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-174054e0-3c1f-48d7-b898-6c5b9df39954 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:47.575414 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-174054e0-3c1f-48d7-b898-6c5b9df39954 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:47.576185 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-174054e0-3c1f-48d7-b898-6c5b9df39954 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:47.576625 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-174054e0-3c1f-48d7-b898-6c5b9df39954 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:47.713696 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-174054e0-3c1f-48d7-b898-6c5b9df39954 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:47.723742 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-174054e0-3c1f-48d7-b898-6c5b9df39954 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:47.725780 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-174054e0-3c1f-48d7-b898-6c5b9df39954 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:47.726923 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-174054e0-3c1f-48d7-b898-6c5b9df39954 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1408 microversion: 2.20 time: 0.163135 Apr 12 00:32:47.727486 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 396/764] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:32:47 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:48.746224 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5d05eda0-5edb-4e4e-b42b-ab34207956a6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:48.746951 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5d05eda0-5edb-4e4e-b42b-ab34207956a6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:48.753048 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5d05eda0-5edb-4e4e-b42b-ab34207956a6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:48.753497 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5d05eda0-5edb-4e4e-b42b-ab34207956a6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:48.754273 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5d05eda0-5edb-4e4e-b42b-ab34207956a6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:48.754717 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5d05eda0-5edb-4e4e-b42b-ab34207956a6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:48.878577 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-5d05eda0-5edb-4e4e-b42b-ab34207956a6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:48.887118 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-5d05eda0-5edb-4e4e-b42b-ab34207956a6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:48.888623 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-5d05eda0-5edb-4e4e-b42b-ab34207956a6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:48.889728 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5d05eda0-5edb-4e4e-b42b-ab34207956a6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1408 microversion: 2.20 time: 0.148279 Apr 12 00:32:48.890311 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 369/765] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:32:48 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:49.907323 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-07c1383e-2316-45ce-8835-9c61d1801ff8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:49.907926 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-07c1383e-2316-45ce-8835-9c61d1801ff8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:49.914208 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-07c1383e-2316-45ce-8835-9c61d1801ff8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:49.914692 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-07c1383e-2316-45ce-8835-9c61d1801ff8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:49.915446 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-07c1383e-2316-45ce-8835-9c61d1801ff8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:49.915877 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-07c1383e-2316-45ce-8835-9c61d1801ff8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:50.044040 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-07c1383e-2316-45ce-8835-9c61d1801ff8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:50.051660 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-07c1383e-2316-45ce-8835-9c61d1801ff8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:50.053945 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-07c1383e-2316-45ce-8835-9c61d1801ff8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:32:50.055185 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-07c1383e-2316-45ce-8835-9c61d1801ff8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1600 microversion: 2.20 time: 0.151851 Apr 12 00:32:50.055741 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 397/766] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:32:49 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:50.072199 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-8c5bc66b-5d8e-4a5b-a247-45cffbbcdaf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:50.072688 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-8c5bc66b-5d8e-4a5b-a247-45cffbbcdaf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:32:50.078779 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8c5bc66b-5d8e-4a5b-a247-45cffbbcdaf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:50.079222 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8c5bc66b-5d8e-4a5b-a247-45cffbbcdaf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:50.079974 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8c5bc66b-5d8e-4a5b-a247-45cffbbcdaf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:50.080406 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8c5bc66b-5d8e-4a5b-a247-45cffbbcdaf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:50.160132 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-8c5bc66b-5d8e-4a5b-a247-45cffbbcdaf6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091847 Apr 12 00:32:50.160720 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 370/767] 10.222.0.32 () {60 vars in 1315 bytes} [Tue Apr 12 00:32:50 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:32:51.120882 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-1c75cd8b-4745-470b-9363-1a9f89e6ca5b req-87c64663-50e2-4eb4-a60d-146e520c8468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fd000ee-5205-4d02-b7a8-8c99871c8f29", "tag": "0e9155b9-7112-41cd-b8ec-dd359b342b3a"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:51.129349 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-1c75cd8b-4745-470b-9363-1a9f89e6ca5b req-87c64663-50e2-4eb4-a60d-146e520c8468 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:32:51.130085 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-1c75cd8b-4745-470b-9363-1a9f89e6ca5b req-87c64663-50e2-4eb4-a60d-146e520c8468 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:32:51.140407 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-1c75cd8b-4745-470b-9363-1a9f89e6ca5b req-87c64663-50e2-4eb4-a60d-146e520c8468 service nova] Creating event network-changed:0e9155b9-7112-41cd-b8ec-dd359b342b3a for instance 6fd000ee-5205-4d02-b7a8-8c99871c8f29 on hv-cinder-83625 Apr 12 00:32:51.146203 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-1c75cd8b-4745-470b-9363-1a9f89e6ca5b req-87c64663-50e2-4eb4-a60d-146e520c8468 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028421 Apr 12 00:32:51.147087 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 398/768] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:33:02.184441 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-8950a5eb-03e3-443f-ac30-7545b05ba65f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:02.185046 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-8950a5eb-03e3-443f-ac30-7545b05ba65f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:02.190699 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8950a5eb-03e3-443f-ac30-7545b05ba65f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:02.191140 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8950a5eb-03e3-443f-ac30-7545b05ba65f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:02.191918 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8950a5eb-03e3-443f-ac30-7545b05ba65f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:02.193011 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8950a5eb-03e3-443f-ac30-7545b05ba65f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:02.213782 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-8950a5eb-03e3-443f-ac30-7545b05ba65f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lazy-loading 'flavor' on Instance uuid 29aa1426-1684-47b1-aded-1c9c306543bc {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:33:02.282697 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-8950a5eb-03e3-443f-ac30-7545b05ba65f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "POST /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc/action" status: 202 len: 0 microversion: 2.1 time: 0.102436 Apr 12 00:33:02.283386 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 371/769] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Apr 12 00:33:02 2022] POST /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:33:02.293586 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8c15bae9-46fd-49e1-9003-80b0558f5a47 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:02.294877 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8c15bae9-46fd-49e1-9003-80b0558f5a47 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:02.300652 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8c15bae9-46fd-49e1-9003-80b0558f5a47 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:02.301154 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8c15bae9-46fd-49e1-9003-80b0558f5a47 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:02.302516 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8c15bae9-46fd-49e1-9003-80b0558f5a47 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:02.302974 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8c15bae9-46fd-49e1-9003-80b0558f5a47 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:02.436134 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8c15bae9-46fd-49e1-9003-80b0558f5a47 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:02.443435 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8c15bae9-46fd-49e1-9003-80b0558f5a47 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1566 microversion: 2.1 time: 0.154604 Apr 12 00:33:02.443941 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 399/770] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:02 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:03.461413 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3e192f32-ec9d-4742-9145-53ee5c1f3e2a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:03.462128 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3e192f32-ec9d-4742-9145-53ee5c1f3e2a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:03.468612 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3e192f32-ec9d-4742-9145-53ee5c1f3e2a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:03.469052 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3e192f32-ec9d-4742-9145-53ee5c1f3e2a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:03.469806 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3e192f32-ec9d-4742-9145-53ee5c1f3e2a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:03.470236 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3e192f32-ec9d-4742-9145-53ee5c1f3e2a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:03.597825 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-3e192f32-ec9d-4742-9145-53ee5c1f3e2a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:03.605727 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3e192f32-ec9d-4742-9145-53ee5c1f3e2a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1566 microversion: 2.1 time: 0.148602 Apr 12 00:33:03.606322 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 372/771] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:03 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:04.624200 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-177c387b-553d-4877-a78a-00da88c10bdc tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:04.624802 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-177c387b-553d-4877-a78a-00da88c10bdc tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:04.631488 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-177c387b-553d-4877-a78a-00da88c10bdc tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:04.631988 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-177c387b-553d-4877-a78a-00da88c10bdc tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:04.632773 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-177c387b-553d-4877-a78a-00da88c10bdc tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:04.633319 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-177c387b-553d-4877-a78a-00da88c10bdc tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:04.758963 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-177c387b-553d-4877-a78a-00da88c10bdc tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:04.767887 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-177c387b-553d-4877-a78a-00da88c10bdc tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1566 microversion: 2.1 time: 0.147305 Apr 12 00:33:04.768457 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 400/772] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:04 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:05.785337 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-935a0bc0-cad0-44cf-807f-88a97394f182 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:05.785951 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-935a0bc0-cad0-44cf-807f-88a97394f182 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:05.792332 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-935a0bc0-cad0-44cf-807f-88a97394f182 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:05.792786 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-935a0bc0-cad0-44cf-807f-88a97394f182 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:05.793554 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-935a0bc0-cad0-44cf-807f-88a97394f182 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:05.793996 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-935a0bc0-cad0-44cf-807f-88a97394f182 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:05.921911 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-935a0bc0-cad0-44cf-807f-88a97394f182 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:05.929638 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-935a0bc0-cad0-44cf-807f-88a97394f182 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1566 microversion: 2.1 time: 0.148184 Apr 12 00:33:05.930205 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 373/773] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:05 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:06.946674 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-82ffe629-10ce-4dc5-a222-5a3d18851419 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:06.947309 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-82ffe629-10ce-4dc5-a222-5a3d18851419 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:06.953495 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-82ffe629-10ce-4dc5-a222-5a3d18851419 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:06.953941 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-82ffe629-10ce-4dc5-a222-5a3d18851419 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:06.954729 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-82ffe629-10ce-4dc5-a222-5a3d18851419 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:06.955158 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-82ffe629-10ce-4dc5-a222-5a3d18851419 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:07.080131 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-82ffe629-10ce-4dc5-a222-5a3d18851419 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:07.087555 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-82ffe629-10ce-4dc5-a222-5a3d18851419 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1566 microversion: 2.1 time: 0.145431 Apr 12 00:33:07.088121 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 401/774] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:06 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:08.104832 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a87de97d-b4f8-43c2-b182-31035a5d93b4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:08.105360 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a87de97d-b4f8-43c2-b182-31035a5d93b4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:08.111427 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a87de97d-b4f8-43c2-b182-31035a5d93b4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:08.111871 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a87de97d-b4f8-43c2-b182-31035a5d93b4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:08.112629 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a87de97d-b4f8-43c2-b182-31035a5d93b4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:08.113063 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a87de97d-b4f8-43c2-b182-31035a5d93b4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:08.238622 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a87de97d-b4f8-43c2-b182-31035a5d93b4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:08.246412 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a87de97d-b4f8-43c2-b182-31035a5d93b4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1566 microversion: 2.1 time: 0.145656 Apr 12 00:33:08.246980 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 374/775] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:08 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:09.263902 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-807c0e5b-e7df-4cf0-812b-499805197e1c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:09.264523 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-807c0e5b-e7df-4cf0-812b-499805197e1c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:09.271155 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-807c0e5b-e7df-4cf0-812b-499805197e1c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:09.271629 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-807c0e5b-e7df-4cf0-812b-499805197e1c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:09.272378 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-807c0e5b-e7df-4cf0-812b-499805197e1c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:09.272817 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-807c0e5b-e7df-4cf0-812b-499805197e1c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:09.400608 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-807c0e5b-e7df-4cf0-812b-499805197e1c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:09.408181 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-807c0e5b-e7df-4cf0-812b-499805197e1c tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1566 microversion: 2.1 time: 0.148171 Apr 12 00:33:09.408789 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 402/776] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:09 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:10.426149 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2548efb1-3c23-4924-8f7b-6c9477a6bf94 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:10.426870 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2548efb1-3c23-4924-8f7b-6c9477a6bf94 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:10.433218 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2548efb1-3c23-4924-8f7b-6c9477a6bf94 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:10.433735 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2548efb1-3c23-4924-8f7b-6c9477a6bf94 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:10.434604 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2548efb1-3c23-4924-8f7b-6c9477a6bf94 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:10.435116 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-dfc7fef4-7984-49d0-84cb-d6aac91dda4a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:10.435550 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2548efb1-3c23-4924-8f7b-6c9477a6bf94 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:10.435653 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-dfc7fef4-7984-49d0-84cb-d6aac91dda4a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:10.441765 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dfc7fef4-7984-49d0-84cb-d6aac91dda4a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:10.442196 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dfc7fef4-7984-49d0-84cb-d6aac91dda4a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:10.442983 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dfc7fef4-7984-49d0-84cb-d6aac91dda4a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:10.443418 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dfc7fef4-7984-49d0-84cb-d6aac91dda4a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:10.521909 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-dfc7fef4-7984-49d0-84cb-d6aac91dda4a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lazy-loading 'services' on Instance uuid 85a3e7dc-86c5-42ab-8a46-126c80dd1adc {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:33:10.566720 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2548efb1-3c23-4924-8f7b-6c9477a6bf94 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:10.575584 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2548efb1-3c23-4924-8f7b-6c9477a6bf94 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1566 microversion: 2.1 time: 0.153098 Apr 12 00:33:10.576239 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 375/777] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:10 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:10.599073 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-dfc7fef4-7984-49d0-84cb-d6aac91dda4a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "DELETE /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/os-volume_attachments/dcb0d9cc-8bc2-4e6b-9d54-271eff488ce0" status: 202 len: 0 microversion: 2.1 time: 0.167642 Apr 12 00:33:10.599682 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 403/778] 10.222.0.32 () {58 vars in 1415 bytes} [Tue Apr 12 00:33:10 2022] DELETE /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/os-volume_attachments/dcb0d9cc-8bc2-4e6b-9d54-271eff488ce0 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 00:33:10.608547 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-51181aca-717e-4cdf-86eb-a316ceaed65a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:10.609526 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-51181aca-717e-4cdf-86eb-a316ceaed65a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:10.616097 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-51181aca-717e-4cdf-86eb-a316ceaed65a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:10.616660 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-51181aca-717e-4cdf-86eb-a316ceaed65a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:10.617535 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-51181aca-717e-4cdf-86eb-a316ceaed65a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:10.618015 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-51181aca-717e-4cdf-86eb-a316ceaed65a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:10.648033 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-51181aca-717e-4cdf-86eb-a316ceaed65a tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043960 Apr 12 00:33:10.648505 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 376/779] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:33:10 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:11.594468 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-73ef3783-2e47-4a5e-976d-697ea0580cc5 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:11.595159 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-73ef3783-2e47-4a5e-976d-697ea0580cc5 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:11.601611 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-73ef3783-2e47-4a5e-976d-697ea0580cc5 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:11.602057 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-73ef3783-2e47-4a5e-976d-697ea0580cc5 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:11.602836 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-73ef3783-2e47-4a5e-976d-697ea0580cc5 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:11.603267 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-73ef3783-2e47-4a5e-976d-697ea0580cc5 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:11.660289 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5d6b15d8-2d41-42dd-9be6-85f971b7d0d8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:11.661927 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5d6b15d8-2d41-42dd-9be6-85f971b7d0d8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:11.669189 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5d6b15d8-2d41-42dd-9be6-85f971b7d0d8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:11.669319 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5d6b15d8-2d41-42dd-9be6-85f971b7d0d8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:11.670039 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5d6b15d8-2d41-42dd-9be6-85f971b7d0d8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:11.670503 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5d6b15d8-2d41-42dd-9be6-85f971b7d0d8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:11.699964 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5d6b15d8-2d41-42dd-9be6-85f971b7d0d8 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044022 Apr 12 00:33:11.704014 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 377/780] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:33:11 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:11.738733 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-73ef3783-2e47-4a5e-976d-697ea0580cc5 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:11.746025 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-73ef3783-2e47-4a5e-976d-697ea0580cc5 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1566 microversion: 2.1 time: 0.156195 Apr 12 00:33:11.746625 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 404/781] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:11 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:12.712251 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9a29a8d1-48a2-42d9-bc8b-412c11c86d79 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:12.713176 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-9a29a8d1-48a2-42d9-bc8b-412c11c86d79 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:12.719406 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9a29a8d1-48a2-42d9-bc8b-412c11c86d79 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:12.719852 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9a29a8d1-48a2-42d9-bc8b-412c11c86d79 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:12.720619 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9a29a8d1-48a2-42d9-bc8b-412c11c86d79 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:12.721052 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9a29a8d1-48a2-42d9-bc8b-412c11c86d79 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:12.749939 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9a29a8d1-48a2-42d9-bc8b-412c11c86d79 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042268 Apr 12 00:33:12.750540 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 378/782] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:33:12 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:33:12.764298 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ca0114be-2725-4bc8-a15b-02f4b6717cdb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:12.765522 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ca0114be-2725-4bc8-a15b-02f4b6717cdb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:12.772141 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ca0114be-2725-4bc8-a15b-02f4b6717cdb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:12.772594 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ca0114be-2725-4bc8-a15b-02f4b6717cdb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:12.773574 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ca0114be-2725-4bc8-a15b-02f4b6717cdb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:12.774021 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ca0114be-2725-4bc8-a15b-02f4b6717cdb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:12.825380 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-46f63a99-a91c-4d74-9098-842613031a63 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:12.825883 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-46f63a99-a91c-4d74-9098-842613031a63 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:12.832115 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-46f63a99-a91c-4d74-9098-842613031a63 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:12.832602 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-46f63a99-a91c-4d74-9098-842613031a63 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:12.833371 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-46f63a99-a91c-4d74-9098-842613031a63 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:12.833808 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-46f63a99-a91c-4d74-9098-842613031a63 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:12.860064 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-46f63a99-a91c-4d74-9098-842613031a63 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Going to try to terminate instance {{(pid=128487) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:33:12.915505 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ca0114be-2725-4bc8-a15b-02f4b6717cdb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:12.925446 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ca0114be-2725-4bc8-a15b-02f4b6717cdb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1566 microversion: 2.1 time: 0.165770 Apr 12 00:33:12.927455 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 405/783] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:12 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:12.952389 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-46f63a99-a91c-4d74-9098-842613031a63 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "DELETE /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 204 len: 0 microversion: 2.1 time: 0.132013 Apr 12 00:33:12.953402 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 379/784] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:33:12 2022] DELETE /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:33:12.961451 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-73e34323-6413-4568-882f-65d7ab950e9f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:12.962072 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-73e34323-6413-4568-882f-65d7ab950e9f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:12.967807 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-73e34323-6413-4568-882f-65d7ab950e9f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:12.968255 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-73e34323-6413-4568-882f-65d7ab950e9f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:12.969012 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-73e34323-6413-4568-882f-65d7ab950e9f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:12.969610 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-73e34323-6413-4568-882f-65d7ab950e9f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:13.096797 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-73e34323-6413-4568-882f-65d7ab950e9f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:13.105004 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-73e34323-6413-4568-882f-65d7ab950e9f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1689 microversion: 2.1 time: 0.147408 Apr 12 00:33:13.105571 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 406/785] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:12 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:13.945004 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-46bce984-675d-46a2-aa24-ee0946c541de tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:13.945698 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-46bce984-675d-46a2-aa24-ee0946c541de tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:13.952064 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-46bce984-675d-46a2-aa24-ee0946c541de tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:13.952508 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-46bce984-675d-46a2-aa24-ee0946c541de tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:13.953264 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-46bce984-675d-46a2-aa24-ee0946c541de tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:13.953693 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-46bce984-675d-46a2-aa24-ee0946c541de tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:14.084313 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-46bce984-675d-46a2-aa24-ee0946c541de tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:14.091689 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-46bce984-675d-46a2-aa24-ee0946c541de tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1566 microversion: 2.1 time: 0.151495 Apr 12 00:33:14.092252 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 380/786] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:13 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:14.122746 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a9810536-7bf3-44a6-b9a5-4ef16eaacf02 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:14.123354 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a9810536-7bf3-44a6-b9a5-4ef16eaacf02 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:14.130170 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a9810536-7bf3-44a6-b9a5-4ef16eaacf02 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:14.130646 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a9810536-7bf3-44a6-b9a5-4ef16eaacf02 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:14.131398 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a9810536-7bf3-44a6-b9a5-4ef16eaacf02 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:14.131828 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a9810536-7bf3-44a6-b9a5-4ef16eaacf02 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:14.258589 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a9810536-7bf3-44a6-b9a5-4ef16eaacf02 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:14.265805 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a9810536-7bf3-44a6-b9a5-4ef16eaacf02 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1689 microversion: 2.1 time: 0.146948 Apr 12 00:33:14.266386 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 407/787] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:14 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:15.109893 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d4fd68e9-66bb-4b30-9a87-36fb898a2db6 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:15.110591 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d4fd68e9-66bb-4b30-9a87-36fb898a2db6 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:15.116807 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d4fd68e9-66bb-4b30-9a87-36fb898a2db6 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:15.117248 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d4fd68e9-66bb-4b30-9a87-36fb898a2db6 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:15.118000 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d4fd68e9-66bb-4b30-9a87-36fb898a2db6 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:15.118462 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d4fd68e9-66bb-4b30-9a87-36fb898a2db6 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:15.249493 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d4fd68e9-66bb-4b30-9a87-36fb898a2db6 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:15.257741 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d4fd68e9-66bb-4b30-9a87-36fb898a2db6 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1566 microversion: 2.1 time: 0.152787 Apr 12 00:33:15.258317 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 381/788] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:15 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:15.282769 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-6f4763d0-0a97-4526-aafe-2007912fde04 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:15.283457 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-6f4763d0-0a97-4526-aafe-2007912fde04 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:15.289788 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6f4763d0-0a97-4526-aafe-2007912fde04 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:15.290286 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6f4763d0-0a97-4526-aafe-2007912fde04 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:15.291082 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6f4763d0-0a97-4526-aafe-2007912fde04 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:15.291510 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6f4763d0-0a97-4526-aafe-2007912fde04 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:15.420429 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-6f4763d0-0a97-4526-aafe-2007912fde04 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:15.428497 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-6f4763d0-0a97-4526-aafe-2007912fde04 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1689 microversion: 2.1 time: 0.149525 Apr 12 00:33:15.429123 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 408/789] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:15 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:16.277233 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-64ee8744-bd15-4409-97dd-45c8012d0166 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:16.277842 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-64ee8744-bd15-4409-97dd-45c8012d0166 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:16.284809 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-64ee8744-bd15-4409-97dd-45c8012d0166 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:16.285532 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-64ee8744-bd15-4409-97dd-45c8012d0166 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:16.286597 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-64ee8744-bd15-4409-97dd-45c8012d0166 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:16.287082 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-64ee8744-bd15-4409-97dd-45c8012d0166 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:16.420552 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-64ee8744-bd15-4409-97dd-45c8012d0166 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:16.428106 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-64ee8744-bd15-4409-97dd-45c8012d0166 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1566 microversion: 2.1 time: 0.156067 Apr 12 00:33:16.428674 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 382/790] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:16 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:16.445930 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-885daf64-9867-4ccb-b4fc-2d748660bc56 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:16.446608 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-885daf64-9867-4ccb-b4fc-2d748660bc56 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:16.452735 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-885daf64-9867-4ccb-b4fc-2d748660bc56 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:16.453191 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-885daf64-9867-4ccb-b4fc-2d748660bc56 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:16.453955 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-885daf64-9867-4ccb-b4fc-2d748660bc56 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:16.454431 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-885daf64-9867-4ccb-b4fc-2d748660bc56 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:16.586754 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-885daf64-9867-4ccb-b4fc-2d748660bc56 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:16.594192 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-885daf64-9867-4ccb-b4fc-2d748660bc56 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1689 microversion: 2.1 time: 0.152598 Apr 12 00:33:16.594836 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 409/791] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:16 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:17.444901 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9d2831e2-17c4-41de-96ce-fa26a3ab521a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:17.445535 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-9d2831e2-17c4-41de-96ce-fa26a3ab521a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:17.451761 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9d2831e2-17c4-41de-96ce-fa26a3ab521a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:17.452240 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9d2831e2-17c4-41de-96ce-fa26a3ab521a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:17.453000 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9d2831e2-17c4-41de-96ce-fa26a3ab521a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:17.453433 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9d2831e2-17c4-41de-96ce-fa26a3ab521a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:17.578623 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9d2831e2-17c4-41de-96ce-fa26a3ab521a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:17.586489 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9d2831e2-17c4-41de-96ce-fa26a3ab521a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1566 microversion: 2.1 time: 0.145394 Apr 12 00:33:17.587062 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 383/792] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:17 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:17.611880 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c45b1ba7-9765-4d93-87f4-49d66b90f94b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:17.612481 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c45b1ba7-9765-4d93-87f4-49d66b90f94b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:17.618644 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c45b1ba7-9765-4d93-87f4-49d66b90f94b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:17.619088 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c45b1ba7-9765-4d93-87f4-49d66b90f94b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:17.619850 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c45b1ba7-9765-4d93-87f4-49d66b90f94b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:17.620286 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c45b1ba7-9765-4d93-87f4-49d66b90f94b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:17.749374 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-c45b1ba7-9765-4d93-87f4-49d66b90f94b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:17.757054 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c45b1ba7-9765-4d93-87f4-49d66b90f94b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1689 microversion: 2.1 time: 0.149022 Apr 12 00:33:17.757605 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 410/793] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:17 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:18.604225 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4dc33134-4ac0-49ba-b873-b00315ea91fb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:18.604996 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-4dc33134-4ac0-49ba-b873-b00315ea91fb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:18.611677 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4dc33134-4ac0-49ba-b873-b00315ea91fb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:18.612083 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4dc33134-4ac0-49ba-b873-b00315ea91fb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:18.613416 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4dc33134-4ac0-49ba-b873-b00315ea91fb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:18.613866 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4dc33134-4ac0-49ba-b873-b00315ea91fb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:18.776354 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5af3c97f-788d-439c-9076-69ad9e632a49 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:18.777028 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5af3c97f-788d-439c-9076-69ad9e632a49 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:18.783581 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5af3c97f-788d-439c-9076-69ad9e632a49 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:18.784041 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5af3c97f-788d-439c-9076-69ad9e632a49 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:18.784809 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5af3c97f-788d-439c-9076-69ad9e632a49 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:18.785866 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5af3c97f-788d-439c-9076-69ad9e632a49 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:18.810145 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-4dc33134-4ac0-49ba-b873-b00315ea91fb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:18.819231 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-4dc33134-4ac0-49ba-b873-b00315ea91fb tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1567 microversion: 2.1 time: 0.218954 Apr 12 00:33:18.819901 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 384/794] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:18 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:18.838751 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-0d904508-28df-4873-b2ee-5f8f5f93762d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:18.839340 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-0d904508-28df-4873-b2ee-5f8f5f93762d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:18.845901 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0d904508-28df-4873-b2ee-5f8f5f93762d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:18.847040 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0d904508-28df-4873-b2ee-5f8f5f93762d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:18.848584 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0d904508-28df-4873-b2ee-5f8f5f93762d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:18.849770 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0d904508-28df-4873-b2ee-5f8f5f93762d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:18.851970 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5af3c97f-788d-439c-9076-69ad9e632a49 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:18.859967 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5af3c97f-788d-439c-9076-69ad9e632a49 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 200 len: 1621 microversion: 2.1 time: 0.088737 Apr 12 00:33:18.865193 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 411/795] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:18 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 1621 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:18.975013 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-0d904508-28df-4873-b2ee-5f8f5f93762d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "POST /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc/action" status: 202 len: 0 microversion: 2.1 time: 0.140192 Apr 12 00:33:18.981433 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 385/796] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Apr 12 00:33:18 2022] POST /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:33:18.985020 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ae8484db-5e64-4c16-a440-6dfff692d5fe tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:18.985712 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ae8484db-5e64-4c16-a440-6dfff692d5fe tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:18.991294 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-f0c2444f-f21a-42f0-9f86-d880a8052257 req-9283269e-876c-4c5c-b270-d867d2cf6c5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a3e7dc-86c5-42ab-8a46-126c80dd1adc", "name": "network-vif-deleted", "tag": "acbbc313-dcc4-4731-a931-77e1a5d10277"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:18.994571 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ae8484db-5e64-4c16-a440-6dfff692d5fe tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:18.995107 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ae8484db-5e64-4c16-a440-6dfff692d5fe tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:18.995849 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ae8484db-5e64-4c16-a440-6dfff692d5fe tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:18.996281 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ae8484db-5e64-4c16-a440-6dfff692d5fe tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:19.003512 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-f0c2444f-f21a-42f0-9f86-d880a8052257 req-9283269e-876c-4c5c-b270-d867d2cf6c5c service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:19.004131 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-f0c2444f-f21a-42f0-9f86-d880a8052257 req-9283269e-876c-4c5c-b270-d867d2cf6c5c service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:19.020507 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-f0c2444f-f21a-42f0-9f86-d880a8052257 req-9283269e-876c-4c5c-b270-d867d2cf6c5c service nova] Creating event network-vif-deleted:acbbc313-dcc4-4731-a931-77e1a5d10277 for instance 85a3e7dc-86c5-42ab-8a46-126c80dd1adc on hv-cinder-83625 Apr 12 00:33:19.026828 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-f0c2444f-f21a-42f0-9f86-d880a8052257 req-9283269e-876c-4c5c-b270-d867d2cf6c5c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041010 Apr 12 00:33:19.028328 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 386/797] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:33:19.226015 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ae8484db-5e64-4c16-a440-6dfff692d5fe tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:19.238848 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ae8484db-5e64-4c16-a440-6dfff692d5fe tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1515 microversion: 2.1 time: 0.257907 Apr 12 00:33:19.246636 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 412/798] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:18 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1515 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:19.877701 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b2e9ebfc-e9f2-4856-a2b8-dda43e04e2d4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:19.878425 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b2e9ebfc-e9f2-4856-a2b8-dda43e04e2d4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 85a3e7dc-86c5-42ab-8a46-126c80dd1adc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:19.888617 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b2e9ebfc-e9f2-4856-a2b8-dda43e04e2d4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:19.889063 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b2e9ebfc-e9f2-4856-a2b8-dda43e04e2d4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:19.889832 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b2e9ebfc-e9f2-4856-a2b8-dda43e04e2d4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:19.890279 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b2e9ebfc-e9f2-4856-a2b8-dda43e04e2d4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:19.904822 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-b2e9ebfc-e9f2-4856-a2b8-dda43e04e2d4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] HTTP exception thrown: Instance 85a3e7dc-86c5-42ab-8a46-126c80dd1adc could not be found. Apr 12 00:33:19.905434 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b2e9ebfc-e9f2-4856-a2b8-dda43e04e2d4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Returning 404 to user: Instance 85a3e7dc-86c5-42ab-8a46-126c80dd1adc could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:33:19.906337 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b2e9ebfc-e9f2-4856-a2b8-dda43e04e2d4 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc" status: 404 len: 111 microversion: 2.1 time: 0.032837 Apr 12 00:33:19.906923 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 387/799] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:19 2022] GET /compute/v2.1/servers/85a3e7dc-86c5-42ab-8a46-126c80dd1adc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:33:19.915108 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1ce411b5-c47c-4ccf-9534-a05d7d5a7254 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '.version_select at 0x7f64e12eb790>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:19.933734 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1ce411b5-c47c-4ccf-9534-a05d7d5a7254 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-476237608" status: 202 len: 0 microversion: 2.1 time: 0.022343 Apr 12 00:33:19.934339 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 413/800] 10.222.0.32 () {58 vars in 1217 bytes} [Tue Apr 12 00:33:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-476237608 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:33:20.256490 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a3f20f35-24d8-4def-9922-45a3b3a4607d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:20.257219 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a3f20f35-24d8-4def-9922-45a3b3a4607d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:20.263473 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a3f20f35-24d8-4def-9922-45a3b3a4607d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:20.263927 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a3f20f35-24d8-4def-9922-45a3b3a4607d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:20.264853 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a3f20f35-24d8-4def-9922-45a3b3a4607d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:20.265268 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a3f20f35-24d8-4def-9922-45a3b3a4607d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:20.472669 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a3f20f35-24d8-4def-9922-45a3b3a4607d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:20.481058 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a3f20f35-24d8-4def-9922-45a3b3a4607d tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1517 microversion: 2.1 time: 0.229050 Apr 12 00:33:20.481965 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 388/801] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:20 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1517 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:21.498885 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-14516b7f-10ff-429d-b675-229a6e7f77ce tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:21.499611 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-14516b7f-10ff-429d-b675-229a6e7f77ce tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:21.506596 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-14516b7f-10ff-429d-b675-229a6e7f77ce tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:21.507040 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-14516b7f-10ff-429d-b675-229a6e7f77ce tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:21.507806 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-14516b7f-10ff-429d-b675-229a6e7f77ce tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:21.508244 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-14516b7f-10ff-429d-b675-229a6e7f77ce tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:21.642952 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-14516b7f-10ff-429d-b675-229a6e7f77ce tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:21.651312 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-14516b7f-10ff-429d-b675-229a6e7f77ce tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1573 microversion: 2.1 time: 0.156801 Apr 12 00:33:21.651917 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 414/802] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:21 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:21.772223 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-947e87e6-6df1-4ba4-aff3-089675f07620 req-d1946302-10d2-42ad-a20b-03c83aeb51b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29aa1426-1684-47b1-aded-1c9c306543bc", "name": "network-vif-unplugged", "status": "completed", "tag": "94406837-92d7-472c-9764-43cc0c5b4cd8"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:21.778769 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-947e87e6-6df1-4ba4-aff3-089675f07620 req-d1946302-10d2-42ad-a20b-03c83aeb51b2 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:21.779475 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-947e87e6-6df1-4ba4-aff3-089675f07620 req-d1946302-10d2-42ad-a20b-03c83aeb51b2 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:21.791552 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-947e87e6-6df1-4ba4-aff3-089675f07620 req-d1946302-10d2-42ad-a20b-03c83aeb51b2 service nova] Creating event network-vif-unplugged:94406837-92d7-472c-9764-43cc0c5b4cd8 for instance 29aa1426-1684-47b1-aded-1c9c306543bc on hv-cinder-83625 Apr 12 00:33:21.796931 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-947e87e6-6df1-4ba4-aff3-089675f07620 req-d1946302-10d2-42ad-a20b-03c83aeb51b2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031283 Apr 12 00:33:21.797875 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 389/803] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:33:22.669626 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-90632fdf-be3f-4260-a780-1aac5ec9e5a4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:22.670031 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-90632fdf-be3f-4260-a780-1aac5ec9e5a4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:22.676052 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-90632fdf-be3f-4260-a780-1aac5ec9e5a4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:22.676495 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-90632fdf-be3f-4260-a780-1aac5ec9e5a4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:22.677252 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-90632fdf-be3f-4260-a780-1aac5ec9e5a4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:22.677684 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-90632fdf-be3f-4260-a780-1aac5ec9e5a4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:22.804996 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-90632fdf-be3f-4260-a780-1aac5ec9e5a4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:22.812283 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-90632fdf-be3f-4260-a780-1aac5ec9e5a4 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1573 microversion: 2.1 time: 0.147233 Apr 12 00:33:22.812853 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 415/804] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:22 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:22.908939 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b2575b2f-cbd3-4f7d-9f19-c35997769bb6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:22.909519 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b2575b2f-cbd3-4f7d-9f19-c35997769bb6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:22.915471 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b2575b2f-cbd3-4f7d-9f19-c35997769bb6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:22.915918 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b2575b2f-cbd3-4f7d-9f19-c35997769bb6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:22.916674 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b2575b2f-cbd3-4f7d-9f19-c35997769bb6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:22.917111 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b2575b2f-cbd3-4f7d-9f19-c35997769bb6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:22.942739 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b2575b2f-cbd3-4f7d-9f19-c35997769bb6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Going to try to terminate instance {{(pid=128487) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:33:23.015089 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b2575b2f-cbd3-4f7d-9f19-c35997769bb6 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "DELETE /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 204 len: 0 microversion: 2.1 time: 0.110429 Apr 12 00:33:23.015696 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 390/805] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:33:22 2022] DELETE /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:33:23.025141 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-65372cc4-5a24-498b-8992-d45126ba7472 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:23.025751 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-65372cc4-5a24-498b-8992-d45126ba7472 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:23.031690 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-65372cc4-5a24-498b-8992-d45126ba7472 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:23.032169 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-65372cc4-5a24-498b-8992-d45126ba7472 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:23.032926 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-65372cc4-5a24-498b-8992-d45126ba7472 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:23.033413 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-65372cc4-5a24-498b-8992-d45126ba7472 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:23.158465 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-65372cc4-5a24-498b-8992-d45126ba7472 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:23.165668 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-65372cc4-5a24-498b-8992-d45126ba7472 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1507 microversion: 2.1 time: 0.144384 Apr 12 00:33:23.166223 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 416/806] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:23 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1507 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:23.829350 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-35ced771-3c29-4d6e-add9-73c6877e58a2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:23.830791 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-35ced771-3c29-4d6e-add9-73c6877e58a2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:23.837166 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35ced771-3c29-4d6e-add9-73c6877e58a2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:23.837651 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35ced771-3c29-4d6e-add9-73c6877e58a2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:23.838459 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35ced771-3c29-4d6e-add9-73c6877e58a2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:23.838903 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35ced771-3c29-4d6e-add9-73c6877e58a2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:24.074221 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-35ced771-3c29-4d6e-add9-73c6877e58a2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:24.082588 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-35ced771-3c29-4d6e-add9-73c6877e58a2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1573 microversion: 2.1 time: 0.256883 Apr 12 00:33:24.083173 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 391/807] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:23 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1573 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:24.182667 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-dc212294-1de4-4e51-997d-2fc12c986e6c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:24.183279 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-dc212294-1de4-4e51-997d-2fc12c986e6c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:24.190069 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dc212294-1de4-4e51-997d-2fc12c986e6c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:24.190667 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dc212294-1de4-4e51-997d-2fc12c986e6c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:24.192163 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dc212294-1de4-4e51-997d-2fc12c986e6c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:24.192753 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dc212294-1de4-4e51-997d-2fc12c986e6c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:24.335944 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-dc212294-1de4-4e51-997d-2fc12c986e6c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:24.337488 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-fc09f291-5c83-473b-80f6-f1a4373c8c07 req-0be463ac-77fa-46bf-88a4-d0611bcfe10f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "436e51f9-0f9a-4bb2-a03e-b53050e1dc80", "name": "network-vif-deleted", "tag": "d8fd308a-3656-4572-a37f-0f014a01f3f9"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:24.346121 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-fc09f291-5c83-473b-80f6-f1a4373c8c07 req-0be463ac-77fa-46bf-88a4-d0611bcfe10f service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:24.346716 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-dc212294-1de4-4e51-997d-2fc12c986e6c tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 200 len: 1507 microversion: 2.1 time: 0.167403 Apr 12 00:33:24.346883 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-fc09f291-5c83-473b-80f6-f1a4373c8c07 req-0be463ac-77fa-46bf-88a4-d0611bcfe10f service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:24.347508 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 417/808] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:24 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:24.358287 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-fc09f291-5c83-473b-80f6-f1a4373c8c07 req-0be463ac-77fa-46bf-88a4-d0611bcfe10f service nova] Creating event network-vif-deleted:d8fd308a-3656-4572-a37f-0f014a01f3f9 for instance 436e51f9-0f9a-4bb2-a03e-b53050e1dc80 on hv-cinder-83625 Apr 12 00:33:24.367436 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-fc09f291-5c83-473b-80f6-f1a4373c8c07 req-0be463ac-77fa-46bf-88a4-d0611bcfe10f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033396 Apr 12 00:33:24.368076 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 392/809] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:33:25.099800 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3f82acc0-f62a-49df-ad7c-f6ba94bdfc6e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:25.100415 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3f82acc0-f62a-49df-ad7c-f6ba94bdfc6e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:25.106754 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3f82acc0-f62a-49df-ad7c-f6ba94bdfc6e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:25.107227 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3f82acc0-f62a-49df-ad7c-f6ba94bdfc6e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:25.108016 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3f82acc0-f62a-49df-ad7c-f6ba94bdfc6e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:25.108473 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3f82acc0-f62a-49df-ad7c-f6ba94bdfc6e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:25.237195 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3f82acc0-f62a-49df-ad7c-f6ba94bdfc6e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:25.244503 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3f82acc0-f62a-49df-ad7c-f6ba94bdfc6e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1573 microversion: 2.1 time: 0.148604 Apr 12 00:33:25.245073 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 418/810] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:25 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:25.365399 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4aeebb5a-3029-4d35-b65d-c5cc08a8a335 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:25.366021 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-4aeebb5a-3029-4d35-b65d-c5cc08a8a335 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 436e51f9-0f9a-4bb2-a03e-b53050e1dc80] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:25.372006 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4aeebb5a-3029-4d35-b65d-c5cc08a8a335 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:25.372449 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4aeebb5a-3029-4d35-b65d-c5cc08a8a335 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:25.373200 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4aeebb5a-3029-4d35-b65d-c5cc08a8a335 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:25.373626 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4aeebb5a-3029-4d35-b65d-c5cc08a8a335 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:25.387028 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-4aeebb5a-3029-4d35-b65d-c5cc08a8a335 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] HTTP exception thrown: Instance 436e51f9-0f9a-4bb2-a03e-b53050e1dc80 could not be found. Apr 12 00:33:25.387599 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4aeebb5a-3029-4d35-b65d-c5cc08a8a335 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Returning 404 to user: Instance 436e51f9-0f9a-4bb2-a03e-b53050e1dc80 could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:33:25.388391 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-4aeebb5a-3029-4d35-b65d-c5cc08a8a335 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80" status: 404 len: 111 microversion: 2.1 time: 0.028231 Apr 12 00:33:25.388906 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 393/811] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:25 2022] GET /compute/v2.1/servers/436e51f9-0f9a-4bb2-a03e-b53050e1dc80 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:33:25.396947 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4fdd6c0f-3a1d-45a9-ac1f-ab1eaffebcf3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:25.397446 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4fdd6c0f-3a1d-45a9-ac1f-ab1eaffebcf3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:25.403336 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4fdd6c0f-3a1d-45a9-ac1f-ab1eaffebcf3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:25.403792 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4fdd6c0f-3a1d-45a9-ac1f-ab1eaffebcf3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:25.404578 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4fdd6c0f-3a1d-45a9-ac1f-ab1eaffebcf3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:25.405110 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4fdd6c0f-3a1d-45a9-ac1f-ab1eaffebcf3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:25.430498 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4fdd6c0f-3a1d-45a9-ac1f-ab1eaffebcf3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Going to try to terminate instance {{(pid=128486) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:33:25.503157 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4fdd6c0f-3a1d-45a9-ac1f-ab1eaffebcf3 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 204 len: 0 microversion: 2.1 time: 0.109669 Apr 12 00:33:25.503872 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 419/812] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:33:25 2022] DELETE /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 00:33:25.512498 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-db75d9cd-c6b8-49ba-be21-0b8af1761c8e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:25.513097 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-db75d9cd-c6b8-49ba-be21-0b8af1761c8e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:25.519109 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-db75d9cd-c6b8-49ba-be21-0b8af1761c8e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:25.519553 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-db75d9cd-c6b8-49ba-be21-0b8af1761c8e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:25.520307 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-db75d9cd-c6b8-49ba-be21-0b8af1761c8e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:25.520736 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-db75d9cd-c6b8-49ba-be21-0b8af1761c8e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:25.645979 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-db75d9cd-c6b8-49ba-be21-0b8af1761c8e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:25.653125 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-db75d9cd-c6b8-49ba-be21-0b8af1761c8e tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.144524 Apr 12 00:33:25.653680 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 394/813] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:25 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:26.262292 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ec3a6bec-1bd4-4303-8349-5143baeb0e3e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:26.263017 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ec3a6bec-1bd4-4303-8349-5143baeb0e3e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:26.269976 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ec3a6bec-1bd4-4303-8349-5143baeb0e3e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:26.270451 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ec3a6bec-1bd4-4303-8349-5143baeb0e3e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:26.271206 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ec3a6bec-1bd4-4303-8349-5143baeb0e3e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:26.271636 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ec3a6bec-1bd4-4303-8349-5143baeb0e3e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:26.398223 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ec3a6bec-1bd4-4303-8349-5143baeb0e3e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:26.406078 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ec3a6bec-1bd4-4303-8349-5143baeb0e3e tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1573 microversion: 2.1 time: 0.147957 Apr 12 00:33:26.406671 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 420/814] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:26 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:26.670666 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-71ec073a-42c7-437f-a243-ecd4da40ac37 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:26.671279 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-71ec073a-42c7-437f-a243-ecd4da40ac37 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:26.678202 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71ec073a-42c7-437f-a243-ecd4da40ac37 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:26.678672 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71ec073a-42c7-437f-a243-ecd4da40ac37 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:26.679434 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71ec073a-42c7-437f-a243-ecd4da40ac37 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:26.679868 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71ec073a-42c7-437f-a243-ecd4da40ac37 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:26.805157 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-71ec073a-42c7-437f-a243-ecd4da40ac37 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:26.812422 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-71ec073a-42c7-437f-a243-ecd4da40ac37 tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.145629 Apr 12 00:33:26.812990 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 395/815] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:26 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:27.424629 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1a536ee1-d891-40da-9433-09b8e5043825 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:27.425234 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1a536ee1-d891-40da-9433-09b8e5043825 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:27.432175 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1a536ee1-d891-40da-9433-09b8e5043825 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:27.432626 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1a536ee1-d891-40da-9433-09b8e5043825 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:27.433380 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1a536ee1-d891-40da-9433-09b8e5043825 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:27.433814 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1a536ee1-d891-40da-9433-09b8e5043825 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:27.564999 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1a536ee1-d891-40da-9433-09b8e5043825 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:27.572287 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1a536ee1-d891-40da-9433-09b8e5043825 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1573 microversion: 2.1 time: 0.151696 Apr 12 00:33:27.572856 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 421/816] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:27 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:27.829204 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-67b55bab-6d12-414b-87d0-51693dd5e7cc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:27.829811 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-67b55bab-6d12-414b-87d0-51693dd5e7cc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:27.836618 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-67b55bab-6d12-414b-87d0-51693dd5e7cc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:27.837058 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-67b55bab-6d12-414b-87d0-51693dd5e7cc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:27.837810 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-67b55bab-6d12-414b-87d0-51693dd5e7cc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:27.838236 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-67b55bab-6d12-414b-87d0-51693dd5e7cc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:27.963505 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-67b55bab-6d12-414b-87d0-51693dd5e7cc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:27.970885 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-67b55bab-6d12-414b-87d0-51693dd5e7cc tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.145818 Apr 12 00:33:27.971597 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 396/817] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:27 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:28.588471 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-efc1786b-3e5c-4703-b6bd-f72ff43ded47 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:28.589083 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-efc1786b-3e5c-4703-b6bd-f72ff43ded47 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:28.595047 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-efc1786b-3e5c-4703-b6bd-f72ff43ded47 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:28.595498 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-efc1786b-3e5c-4703-b6bd-f72ff43ded47 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:28.596266 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-efc1786b-3e5c-4703-b6bd-f72ff43ded47 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:28.596703 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-efc1786b-3e5c-4703-b6bd-f72ff43ded47 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:28.722101 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-efc1786b-3e5c-4703-b6bd-f72ff43ded47 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:28.729945 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-efc1786b-3e5c-4703-b6bd-f72ff43ded47 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1573 microversion: 2.1 time: 0.145467 Apr 12 00:33:28.730555 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 422/818] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:28 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1573 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:28.989000 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4e893ec6-7cae-41b0-8731-dd93c7461d1d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:28.989590 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-4e893ec6-7cae-41b0-8731-dd93c7461d1d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:28.996876 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4e893ec6-7cae-41b0-8731-dd93c7461d1d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:28.997459 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4e893ec6-7cae-41b0-8731-dd93c7461d1d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:28.998727 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4e893ec6-7cae-41b0-8731-dd93c7461d1d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:28.999230 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4e893ec6-7cae-41b0-8731-dd93c7461d1d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:29.209567 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-4e893ec6-7cae-41b0-8731-dd93c7461d1d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:29.217778 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-4e893ec6-7cae-41b0-8731-dd93c7461d1d tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1523 microversion: 2.1 time: 0.233153 Apr 12 00:33:29.227237 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 397/819] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:28 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:29.590097 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-f8e3e00d-08c6-458b-8395-5ccd1e7ba3d7 req-735b3828-f70a-4631-9442-94fcea474c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7526a5-050f-4c25-8432-e85eddf41b98", "name": "network-vif-deleted", "tag": "e2528e14-c8a3-4f63-b34e-364aedc6fb6a"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:29.601297 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-f8e3e00d-08c6-458b-8395-5ccd1e7ba3d7 req-735b3828-f70a-4631-9442-94fcea474c70 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:29.601754 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-f8e3e00d-08c6-458b-8395-5ccd1e7ba3d7 req-735b3828-f70a-4631-9442-94fcea474c70 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:29.615142 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-f8e3e00d-08c6-458b-8395-5ccd1e7ba3d7 req-735b3828-f70a-4631-9442-94fcea474c70 service nova] Creating event network-vif-deleted:e2528e14-c8a3-4f63-b34e-364aedc6fb6a for instance 1f7526a5-050f-4c25-8432-e85eddf41b98 on hv-cinder-83625 Apr 12 00:33:29.620255 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-f8e3e00d-08c6-458b-8395-5ccd1e7ba3d7 req-735b3828-f70a-4631-9442-94fcea474c70 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033865 Apr 12 00:33:29.620867 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 423/820] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:29.746759 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-49e61d55-b912-4c71-81f8-dff48445ecd0 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:29.747369 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-49e61d55-b912-4c71-81f8-dff48445ecd0 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:29.753641 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-49e61d55-b912-4c71-81f8-dff48445ecd0 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:29.754157 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-49e61d55-b912-4c71-81f8-dff48445ecd0 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:29.755118 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-49e61d55-b912-4c71-81f8-dff48445ecd0 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:29.755584 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-49e61d55-b912-4c71-81f8-dff48445ecd0 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:29.888442 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-49e61d55-b912-4c71-81f8-dff48445ecd0 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:29.896334 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-49e61d55-b912-4c71-81f8-dff48445ecd0 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1573 microversion: 2.1 time: 0.153442 Apr 12 00:33:29.897539 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 398/821] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:29 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:30.234366 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-23e2e062-6d40-44ba-aa46-7bf2913c109f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:30.235057 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-23e2e062-6d40-44ba-aa46-7bf2913c109f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:30.242108 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-23e2e062-6d40-44ba-aa46-7bf2913c109f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:30.242585 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-23e2e062-6d40-44ba-aa46-7bf2913c109f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:30.243338 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-23e2e062-6d40-44ba-aa46-7bf2913c109f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:30.243769 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-23e2e062-6d40-44ba-aa46-7bf2913c109f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:30.304253 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-23e2e062-6d40-44ba-aa46-7bf2913c109f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:30.311448 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-23e2e062-6d40-44ba-aa46-7bf2913c109f tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1307 microversion: 2.1 time: 0.081282 Apr 12 00:33:30.312023 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 424/822] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:30 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1307 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:30.915035 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e2833499-9a85-40b6-839c-89d3a50a2cde tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:30.915729 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e2833499-9a85-40b6-839c-89d3a50a2cde tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:30.922400 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e2833499-9a85-40b6-839c-89d3a50a2cde tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:30.922859 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e2833499-9a85-40b6-839c-89d3a50a2cde tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:30.923729 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e2833499-9a85-40b6-839c-89d3a50a2cde tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:30.924229 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e2833499-9a85-40b6-839c-89d3a50a2cde tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:31.057335 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e2833499-9a85-40b6-839c-89d3a50a2cde tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:31.064839 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e2833499-9a85-40b6-839c-89d3a50a2cde tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1560 microversion: 2.1 time: 0.153997 Apr 12 00:33:31.065431 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 399/823] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:30 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:31.328058 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-382d4e37-a0eb-46f0-829e-263dc981b73b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:31.328679 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-382d4e37-a0eb-46f0-829e-263dc981b73b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:31.335692 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-382d4e37-a0eb-46f0-829e-263dc981b73b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:31.336146 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-382d4e37-a0eb-46f0-829e-263dc981b73b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:31.336916 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-382d4e37-a0eb-46f0-829e-263dc981b73b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:31.337354 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-382d4e37-a0eb-46f0-829e-263dc981b73b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:31.368616 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-382d4e37-a0eb-46f0-829e-263dc981b73b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:31.369061 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-382d4e37-a0eb-46f0-829e-263dc981b73b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:31.369500 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-382d4e37-a0eb-46f0-829e-263dc981b73b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lazy-loading 'fault' on Instance uuid 1f7526a5-050f-4c25-8432-e85eddf41b98 {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:33:31.412978 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-382d4e37-a0eb-46f0-829e-263dc981b73b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b434038833084579adf853df718315b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdba79df5fc4c3faa187bd65479d3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:31.421273 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-382d4e37-a0eb-46f0-829e-263dc981b73b tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 200 len: 1312 microversion: 2.1 time: 0.097023 Apr 12 00:33:31.421972 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 425/824] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:31 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:31.707131 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-b5210b33-b424-424c-8eb8-da7e8e0eba13 req-3db4981a-2630-4d8a-9f51-f1bf74589b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29aa1426-1684-47b1-aded-1c9c306543bc", "name": "network-vif-plugged", "status": "completed", "tag": "94406837-92d7-472c-9764-43cc0c5b4cd8"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:31.715017 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-b5210b33-b424-424c-8eb8-da7e8e0eba13 req-3db4981a-2630-4d8a-9f51-f1bf74589b72 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:31.715452 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-b5210b33-b424-424c-8eb8-da7e8e0eba13 req-3db4981a-2630-4d8a-9f51-f1bf74589b72 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:31.726874 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-b5210b33-b424-424c-8eb8-da7e8e0eba13 req-3db4981a-2630-4d8a-9f51-f1bf74589b72 service nova] Creating event network-vif-plugged:94406837-92d7-472c-9764-43cc0c5b4cd8 for instance 29aa1426-1684-47b1-aded-1c9c306543bc on hv-cinder-83625 Apr 12 00:33:31.732123 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-b5210b33-b424-424c-8eb8-da7e8e0eba13 req-3db4981a-2630-4d8a-9f51-f1bf74589b72 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029054 Apr 12 00:33:31.732807 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 400/825] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:32.438580 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-d8dec50c-5edd-46e7-a4dc-51098d6d47dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:32.439182 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-d8dec50c-5edd-46e7-a4dc-51098d6d47dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] [instance: 1f7526a5-050f-4c25-8432-e85eddf41b98] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:32.445491 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d8dec50c-5edd-46e7-a4dc-51098d6d47dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:32.445934 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d8dec50c-5edd-46e7-a4dc-51098d6d47dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:32.446716 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d8dec50c-5edd-46e7-a4dc-51098d6d47dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:32.447149 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d8dec50c-5edd-46e7-a4dc-51098d6d47dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:32.460828 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-d8dec50c-5edd-46e7-a4dc-51098d6d47dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] HTTP exception thrown: Instance 1f7526a5-050f-4c25-8432-e85eddf41b98 could not be found. Apr 12 00:33:32.461392 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-d8dec50c-5edd-46e7-a4dc-51098d6d47dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] Returning 404 to user: Instance 1f7526a5-050f-4c25-8432-e85eddf41b98 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:33:32.462190 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-d8dec50c-5edd-46e7-a4dc-51098d6d47dd tempest-ServerRescueNegativeTestJSON-42600062 tempest-ServerRescueNegativeTestJSON-42600062-project] 10.222.0.32 "GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98" status: 404 len: 111 microversion: 2.1 time: 0.027472 Apr 12 00:33:32.462728 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 426/826] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:32 2022] GET /compute/v2.1/servers/1f7526a5-050f-4c25-8432-e85eddf41b98 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:33:37.193071 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-707a9459-39a0-4c52-a41c-f89540e1e6ff tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Action: 'create', calling method: .version_select at 0x7f64e12dddc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-666763607"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:37.466282 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-707a9459-39a0-4c52-a41c-f89540e1e6ff tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.381869 Apr 12 00:33:37.472641 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 401/827] 10.222.0.32 () {60 vars in 1154 bytes} [Tue Apr 12 00:33:37 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 383 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 12 00:33:37.477797 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-cc9e4ff8-41fd-44a1-a137-62154b96f802 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e13869d0>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:37.527641 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-cc9e4ff8-41fd-44a1-a137-62154b96f802 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/7d32f188-a81a-467e-89fc-4c13a8cb2a61" status: 200 len: 344 microversion: 2.1 time: 0.053563 Apr 12 00:33:37.528255 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 427/828] 10.222.0.32 () {58 vars in 1244 bytes} [Tue Apr 12 00:33:37 2022] GET /compute/v2.1/os-volumes/7d32f188-a81a-467e-89fc-4c13a8cb2a61 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:38.541570 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3a1fb167-4f34-4958-be7f-65d11ed8250d tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e1239dc0>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:38.590108 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3a1fb167-4f34-4958-be7f-65d11ed8250d tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/7d32f188-a81a-467e-89fc-4c13a8cb2a61" status: 200 len: 345 microversion: 2.1 time: 0.052864 Apr 12 00:33:38.590710 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 402/829] 10.222.0.32 () {58 vars in 1244 bytes} [Tue Apr 12 00:33:38 2022] GET /compute/v2.1/os-volumes/7d32f188-a81a-467e-89fc-4c13a8cb2a61 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:33:38.602738 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-479b7c05-b73b-4575-83bb-db1d3a835c91 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Action: 'create', calling method: .version_select at 0x7f64e1439ee0>, body: {"snapshot": {"volume_id": "7d32f188-a81a-467e-89fc-4c13a8cb2a61", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-686034453"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:38.741406 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-479b7c05-b73b-4575-83bb-db1d3a835c91 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.143073 Apr 12 00:33:38.742145 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 428/830] 10.222.0.32 () {60 vars in 1161 bytes} [Tue Apr 12 00:33:38 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:38.753446 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-db829df9-a76d-4b9f-8014-b60f90ac89e4 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e1239b80>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:38.783259 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-db829df9-a76d-4b9f-8014-b60f90ac89e4 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed" status: 200 len: 286 microversion: 2.1 time: 0.034940 Apr 12 00:33:38.783933 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 403/831] 10.222.0.32 () {58 vars in 1250 bytes} [Tue Apr 12 00:33:38 2022] GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:38.794100 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-cd110808-fa1d-4749-a212-bde0ea212d22 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e13bf550>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:38.835102 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-cd110808-fa1d-4749-a212-bde0ea212d22 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.044785 Apr 12 00:33:38.835657 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 429/832] 10.222.0.32 () {58 vars in 1139 bytes} [Tue Apr 12 00:33:38 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:38.845455 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-7cb582b0-3d4a-49b0-89a4-f5a56a73fa50 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e12dd1f0>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:38.873785 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-7cb582b0-3d4a-49b0-89a4-f5a56a73fa50 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed" status: 200 len: 286 microversion: 2.1 time: 0.031935 Apr 12 00:33:38.874510 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 404/833] 10.222.0.32 () {58 vars in 1250 bytes} [Tue Apr 12 00:33:38 2022] GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:39.886056 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-aba21250-221d-4701-abdb-84163eab61dc tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e1439af0>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:39.914467 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-aba21250-221d-4701-abdb-84163eab61dc tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed" status: 200 len: 286 microversion: 2.1 time: 0.032727 Apr 12 00:33:39.915116 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 430/834] 10.222.0.32 () {58 vars in 1250 bytes} [Tue Apr 12 00:33:39 2022] GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:40.927619 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-cb8e4920-2cfb-4186-95e3-4fb47c19e376 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e12faaf0>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:40.956163 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-cb8e4920-2cfb-4186-95e3-4fb47c19e376 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed" status: 200 len: 286 microversion: 2.1 time: 0.033911 Apr 12 00:33:40.956718 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 405/835] 10.222.0.32 () {58 vars in 1250 bytes} [Tue Apr 12 00:33:40 2022] GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:41.968379 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-59ae85c5-7b2c-45f7-8fbb-8ce0ecb66db2 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e13b45e0>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:41.997501 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-59ae85c5-7b2c-45f7-8fbb-8ce0ecb66db2 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed" status: 200 len: 286 microversion: 2.1 time: 0.033515 Apr 12 00:33:42.001490 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 431/836] 10.222.0.32 () {58 vars in 1250 bytes} [Tue Apr 12 00:33:41 2022] GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:43.010218 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-887a020d-d81f-4815-9572-13766c17f583 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e13ab940>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:43.038501 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-887a020d-d81f-4815-9572-13766c17f583 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed" status: 200 len: 286 microversion: 2.1 time: 0.032573 Apr 12 00:33:43.039126 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 406/837] 10.222.0.32 () {58 vars in 1250 bytes} [Tue Apr 12 00:33:43 2022] GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:43.215461 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-d14b6383-0b6a-48fa-8b02-f852bbc757ed tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:43.216369 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-d14b6383-0b6a-48fa-8b02-f852bbc757ed tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:43.222346 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d14b6383-0b6a-48fa-8b02-f852bbc757ed tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:43.222793 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d14b6383-0b6a-48fa-8b02-f852bbc757ed tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:43.223545 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d14b6383-0b6a-48fa-8b02-f852bbc757ed tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:43.223973 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d14b6383-0b6a-48fa-8b02-f852bbc757ed tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:43.250556 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-d14b6383-0b6a-48fa-8b02-f852bbc757ed tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039384 Apr 12 00:33:43.251089 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 432/838] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:33:43 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:33:43.306534 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-665cbe65-a9e2-47d8-8001-b69c6242b73b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:43.307161 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-665cbe65-a9e2-47d8-8001-b69c6242b73b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:43.315376 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-665cbe65-a9e2-47d8-8001-b69c6242b73b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:43.316398 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-665cbe65-a9e2-47d8-8001-b69c6242b73b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:43.317504 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-665cbe65-a9e2-47d8-8001-b69c6242b73b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:43.317935 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-665cbe65-a9e2-47d8-8001-b69c6242b73b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:43.344619 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-665cbe65-a9e2-47d8-8001-b69c6242b73b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Going to try to terminate instance {{(pid=128487) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:33:43.421969 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-665cbe65-a9e2-47d8-8001-b69c6242b73b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 204 len: 0 microversion: 2.1 time: 0.119060 Apr 12 00:33:43.422607 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 407/839] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:33:43 2022] DELETE /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:33:43.431502 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-cdd1737f-567e-4ed5-92d0-dc29bd57c19c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:43.432145 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-cdd1737f-567e-4ed5-92d0-dc29bd57c19c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:43.437929 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-cdd1737f-567e-4ed5-92d0-dc29bd57c19c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:43.438421 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-cdd1737f-567e-4ed5-92d0-dc29bd57c19c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:43.439190 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-cdd1737f-567e-4ed5-92d0-dc29bd57c19c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:43.439635 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-cdd1737f-567e-4ed5-92d0-dc29bd57c19c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:43.563306 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-cdd1737f-567e-4ed5-92d0-dc29bd57c19c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:43.570587 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-cdd1737f-567e-4ed5-92d0-dc29bd57c19c tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1674 microversion: 2.1 time: 0.143289 Apr 12 00:33:43.571198 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 433/840] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:43 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1674 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:44.051192 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3c0605c8-010c-41a6-867c-218ac7910a50 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e151fc10>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:44.080381 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3c0605c8-010c-41a6-867c-218ac7910a50 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed" status: 200 len: 287 microversion: 2.1 time: 0.033388 Apr 12 00:33:44.080936 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 408/841] 10.222.0.32 () {58 vars in 1250 bytes} [Tue Apr 12 00:33:44 2022] GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:44.091478 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-11f01062-7f66-4219-8f1f-63ced7c323de tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e13360d0>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:44.145970 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-11f01062-7f66-4219-8f1f-63ced7c323de tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "DELETE /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed" status: 202 len: 0 microversion: 2.1 time: 0.058268 Apr 12 00:33:44.146672 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 434/842] 10.222.0.32 () {58 vars in 1253 bytes} [Tue Apr 12 00:33:44 2022] DELETE /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:33:44.155079 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1ba261b8-0340-4d14-9ad4-c5b191440b88 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e1350820>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:44.184167 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1ba261b8-0340-4d14-9ad4-c5b191440b88 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed" status: 200 len: 286 microversion: 2.1 time: 0.032854 Apr 12 00:33:44.184736 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 409/843] 10.222.0.32 () {58 vars in 1250 bytes} [Tue Apr 12 00:33:44 2022] GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:44.587994 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3ccfebec-6de8-4aaf-829d-87d6f8e57625 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:44.588570 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3ccfebec-6de8-4aaf-829d-87d6f8e57625 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:44.594374 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3ccfebec-6de8-4aaf-829d-87d6f8e57625 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:44.594827 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3ccfebec-6de8-4aaf-829d-87d6f8e57625 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:44.595584 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3ccfebec-6de8-4aaf-829d-87d6f8e57625 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:44.596014 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3ccfebec-6de8-4aaf-829d-87d6f8e57625 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:44.722481 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3ccfebec-6de8-4aaf-829d-87d6f8e57625 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:44.729693 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3ccfebec-6de8-4aaf-829d-87d6f8e57625 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1674 microversion: 2.1 time: 0.146066 Apr 12 00:33:44.730277 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 435/844] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:44 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:45.196337 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-01b3c332-71cb-49dc-86d1-082a8c451ca2 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e12fac10>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:45.220755 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-01b3c332-71cb-49dc-86d1-082a8c451ca2 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] HTTP exception thrown: Snapshot 671f9300-62c8-4793-912d-a5b777d431ed could not be found. Apr 12 00:33:45.221348 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-01b3c332-71cb-49dc-86d1-082a8c451ca2 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Returning 404 to user: Snapshot 671f9300-62c8-4793-912d-a5b777d431ed could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:33:45.222868 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-01b3c332-71cb-49dc-86d1-082a8c451ca2 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed" status: 404 len: 111 microversion: 2.1 time: 0.030952 Apr 12 00:33:45.223454 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 410/845] 10.222.0.32 () {58 vars in 1250 bytes} [Tue Apr 12 00:33:45 2022] GET /compute/v2.1/os-snapshots/671f9300-62c8-4793-912d-a5b777d431ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:33:45.231439 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-6ec3e704-a8b0-433c-ba75-abb4812dc944 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e13bfe50>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:45.297173 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-6ec3e704-a8b0-433c-ba75-abb4812dc944 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/7d32f188-a81a-467e-89fc-4c13a8cb2a61" status: 202 len: 0 microversion: 2.1 time: 0.069455 Apr 12 00:33:45.301463 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 436/846] 10.222.0.32 () {58 vars in 1247 bytes} [Tue Apr 12 00:33:45 2022] DELETE /compute/v2.1/os-volumes/7d32f188-a81a-467e-89fc-4c13a8cb2a61 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:33:45.306640 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-bf55eb36-7937-44ae-a801-3fca5c759daf tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e12210d0>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:45.363082 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-bf55eb36-7937-44ae-a801-3fca5c759daf tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/7d32f188-a81a-467e-89fc-4c13a8cb2a61" status: 200 len: 344 microversion: 2.1 time: 0.060225 Apr 12 00:33:45.363662 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 411/847] 10.222.0.32 () {58 vars in 1244 bytes} [Tue Apr 12 00:33:45 2022] GET /compute/v2.1/os-volumes/7d32f188-a81a-467e-89fc-4c13a8cb2a61 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:45.715733 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-8cedc469-cb24-4f09-99ba-292883a98935 req-c8ae627f-63a2-4704-8629-2476c1f2248c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6812d1c1-9663-404e-a23f-db9a8dc7e766", "name": "network-vif-deleted", "tag": "9859cd42-a040-4515-a314-efe078c16231"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:45.726606 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-8cedc469-cb24-4f09-99ba-292883a98935 req-c8ae627f-63a2-4704-8629-2476c1f2248c service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:45.727048 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-8cedc469-cb24-4f09-99ba-292883a98935 req-c8ae627f-63a2-4704-8629-2476c1f2248c service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:45.748125 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-7260fd98-0b7c-44fa-96b7-107bbf91cc05 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:45.749522 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-7260fd98-0b7c-44fa-96b7-107bbf91cc05 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:45.750940 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-8cedc469-cb24-4f09-99ba-292883a98935 req-c8ae627f-63a2-4704-8629-2476c1f2248c service nova] Creating event network-vif-deleted:9859cd42-a040-4515-a314-efe078c16231 for instance 6812d1c1-9663-404e-a23f-db9a8dc7e766 on hv-cinder-83625 Apr 12 00:33:45.755936 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-8cedc469-cb24-4f09-99ba-292883a98935 req-c8ae627f-63a2-4704-8629-2476c1f2248c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044695 Apr 12 00:33:45.756754 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 437/848] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:33:45.757100 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7260fd98-0b7c-44fa-96b7-107bbf91cc05 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:45.757620 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7260fd98-0b7c-44fa-96b7-107bbf91cc05 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:45.759464 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7260fd98-0b7c-44fa-96b7-107bbf91cc05 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:45.760579 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7260fd98-0b7c-44fa-96b7-107bbf91cc05 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:45.833901 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-7260fd98-0b7c-44fa-96b7-107bbf91cc05 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:45.842668 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-7260fd98-0b7c-44fa-96b7-107bbf91cc05 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 200 len: 1323 microversion: 2.1 time: 0.098910 Apr 12 00:33:45.843834 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 412/849] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:45 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 1323 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:46.377990 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2b51e74b-90b5-4c70-965a-012b928d79f8 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e13b4040>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:46.407474 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-2b51e74b-90b5-4c70-965a-012b928d79f8 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] HTTP exception thrown: Volume 7d32f188-a81a-467e-89fc-4c13a8cb2a61 could not be found. Apr 12 00:33:46.408349 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2b51e74b-90b5-4c70-965a-012b928d79f8 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Returning 404 to user: Volume 7d32f188-a81a-467e-89fc-4c13a8cb2a61 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:33:46.409262 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2b51e74b-90b5-4c70-965a-012b928d79f8 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/7d32f188-a81a-467e-89fc-4c13a8cb2a61" status: 404 len: 109 microversion: 2.1 time: 0.037347 Apr 12 00:33:46.409812 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 438/850] 10.222.0.32 () {58 vars in 1244 bytes} [Tue Apr 12 00:33:46 2022] GET /compute/v2.1/os-volumes/7d32f188-a81a-467e-89fc-4c13a8cb2a61 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:33:46.423682 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-73a8e73a-8db8-41ca-bf8b-4a1d8fe9d084 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e136d040>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:46.454971 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-73a8e73a-8db8-41ca-bf8b-4a1d8fe9d084 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] HTTP exception thrown: Volume 7d32f188-a81a-467e-89fc-4c13a8cb2a61 could not be found. Apr 12 00:33:46.455572 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-73a8e73a-8db8-41ca-bf8b-4a1d8fe9d084 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Returning 404 to user: Volume 7d32f188-a81a-467e-89fc-4c13a8cb2a61 could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:33:46.457091 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-73a8e73a-8db8-41ca-bf8b-4a1d8fe9d084 tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/7d32f188-a81a-467e-89fc-4c13a8cb2a61" status: 404 len: 109 microversion: 2.1 time: 0.037403 Apr 12 00:33:46.457710 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 413/851] 10.222.0.32 () {58 vars in 1247 bytes} [Tue Apr 12 00:33:46 2022] DELETE /compute/v2.1/os-volumes/7d32f188-a81a-467e-89fc-4c13a8cb2a61 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 00:33:46.465499 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7d3437f7-3c8b-45ab-9228-c789365011dd tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Calling method '.version_select at 0x7f64e14398b0>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:46.494131 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-7d3437f7-3c8b-45ab-9228-c789365011dd tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] HTTP exception thrown: Volume 7d32f188-a81a-467e-89fc-4c13a8cb2a61 could not be found. Apr 12 00:33:46.494828 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7d3437f7-3c8b-45ab-9228-c789365011dd tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] Returning 404 to user: Volume 7d32f188-a81a-467e-89fc-4c13a8cb2a61 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:33:46.495682 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7d3437f7-3c8b-45ab-9228-c789365011dd tempest-VolumesSnapshotsTestJSON-1173033742 tempest-VolumesSnapshotsTestJSON-1173033742-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/7d32f188-a81a-467e-89fc-4c13a8cb2a61" status: 404 len: 109 microversion: 2.1 time: 0.034017 Apr 12 00:33:46.496433 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 439/852] 10.222.0.32 () {58 vars in 1244 bytes} [Tue Apr 12 00:33:46 2022] GET /compute/v2.1/os-volumes/7d32f188-a81a-467e-89fc-4c13a8cb2a61 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:33:46.859631 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-93638d9f-3f08-4247-927e-c6755e66e9f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:46.860383 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-93638d9f-3f08-4247-927e-c6755e66e9f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:46.868053 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-93638d9f-3f08-4247-927e-c6755e66e9f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:46.868499 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-93638d9f-3f08-4247-927e-c6755e66e9f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:46.869264 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-93638d9f-3f08-4247-927e-c6755e66e9f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:46.869694 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-93638d9f-3f08-4247-927e-c6755e66e9f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:46.882829 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-93638d9f-3f08-4247-927e-c6755e66e9f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] HTTP exception thrown: Instance 6812d1c1-9663-404e-a23f-db9a8dc7e766 could not be found. Apr 12 00:33:46.883417 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-93638d9f-3f08-4247-927e-c6755e66e9f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Returning 404 to user: Instance 6812d1c1-9663-404e-a23f-db9a8dc7e766 could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:33:46.884261 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-93638d9f-3f08-4247-927e-c6755e66e9f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 404 len: 111 microversion: 2.1 time: 0.028450 Apr 12 00:33:46.884816 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 414/853] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:46 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:33:46.894328 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a874606b-8837-4db2-871c-5a425acac9bc tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '.version_select at 0x7f64e13b4a60>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:46.912032 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a874606b-8837-4db2-871c-5a425acac9bc tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517093374" status: 202 len: 0 microversion: 2.1 time: 0.022453 Apr 12 00:33:46.912589 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 440/854] 10.222.0.32 () {58 vars in 1220 bytes} [Tue Apr 12 00:33:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517093374 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:33:47.748967 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-88c1bd7a-57bd-49d7-a7ef-8ece6af92cbb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Action: 'create', calling method: .version_select at 0x7f64e1350d30>, body: {"keypair": {"name": "tempest-keypair-1458530577"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:47.772521 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-88c1bd7a-57bd-49d7-a7ef-8ece6af92cbb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Getting quotas for project c08909d19c8341c5b47846b0cee54fd8. Resources: {'key_pairs'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:33:47.776806 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-88c1bd7a-57bd-49d7-a7ef-8ece6af92cbb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Getting quotas for user e548e01902ba41e79667ed56d602f19a and project c08909d19c8341c5b47846b0cee54fd8. Resources: {'key_pairs'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:33:47.943473 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-88c1bd7a-57bd-49d7-a7ef-8ece6af92cbb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Getting quotas for project c08909d19c8341c5b47846b0cee54fd8. Resources: {'key_pairs'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:33:47.946960 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-88c1bd7a-57bd-49d7-a7ef-8ece6af92cbb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Getting quotas for user e548e01902ba41e79667ed56d602f19a and project c08909d19c8341c5b47846b0cee54fd8. Resources: {'key_pairs'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:33:47.959998 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-88c1bd7a-57bd-49d7-a7ef-8ece6af92cbb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.214832 Apr 12 00:33:47.960593 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 415/855] 10.222.0.32 () {60 vars in 1157 bytes} [Tue Apr 12 00:33:47 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:49.517587 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0938019a-769b-4a44-8155-f2b29b6a6ee4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-773610624", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5adaf9f7-3fa6-44b6-b135-6f9bef0b9df4"}], "security_groups": [{"name": "tempest-securitygroup--1283867728"}], "key_name": "tempest-keypair-1458530577", "user_data": "}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:49.682860 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.network.neutron [None req-0938019a-769b-4a44-8155-f2b29b6a6ee4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] validate_networks() for [('5adaf9f7-3fa6-44b6-b135-6f9bef0b9df4', None, None, None, None, None)] {{(pid=128486) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:33:50.176784 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-0938019a-769b-4a44-8155-f2b29b6a6ee4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Flavor limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:33:50.178273 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-0938019a-769b-4a44-8155-f2b29b6a6ee4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Image limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:33:50.179100 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-0938019a-769b-4a44-8155-f2b29b6a6ee4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Flavor pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:33:50.179514 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-0938019a-769b-4a44-8155-f2b29b6a6ee4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Image pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:33:50.180077 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-0938019a-769b-4a44-8155-f2b29b6a6ee4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:33:50.188627 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0938019a-769b-4a44-8155-f2b29b6a6ee4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:50.189085 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0938019a-769b-4a44-8155-f2b29b6a6ee4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:50.189888 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0938019a-769b-4a44-8155-f2b29b6a6ee4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:50.190414 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0938019a-769b-4a44-8155-f2b29b6a6ee4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:50.208280 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-0938019a-769b-4a44-8155-f2b29b6a6ee4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Getting quotas for project c08909d19c8341c5b47846b0cee54fd8. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:33:50.212391 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-0938019a-769b-4a44-8155-f2b29b6a6ee4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Getting quotas for user e548e01902ba41e79667ed56d602f19a and project c08909d19c8341c5b47846b0cee54fd8. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:33:50.224221 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0938019a-769b-4a44-8155-f2b29b6a6ee4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Going to run 1 instances... {{(pid=128486) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:33:50.226695 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0938019a-769b-4a44-8155-f2b29b6a6ee4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:33:50.275405 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0938019a-769b-4a44-8155-f2b29b6a6ee4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.762488 Apr 12 00:33:50.281285 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 441/856] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:33:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:33:50.287038 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-65d6cf4f-742c-4989-b4c7-ad6b7fe175c8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:50.287646 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-65d6cf4f-742c-4989-b4c7-ad6b7fe175c8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:50.373318 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-65d6cf4f-742c-4989-b4c7-ad6b7fe175c8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:50.381496 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-65d6cf4f-742c-4989-b4c7-ad6b7fe175c8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1237 microversion: 2.1 time: 0.098827 Apr 12 00:33:50.382081 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 416/857] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:50 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1237 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:51.401360 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-98cf05d1-fbc4-4c15-8fa5-1f5311d18c7b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:51.401985 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-98cf05d1-fbc4-4c15-8fa5-1f5311d18c7b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:51.421131 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-98cf05d1-fbc4-4c15-8fa5-1f5311d18c7b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:51.421606 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-98cf05d1-fbc4-4c15-8fa5-1f5311d18c7b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:51.422481 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-98cf05d1-fbc4-4c15-8fa5-1f5311d18c7b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:51.422927 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-98cf05d1-fbc4-4c15-8fa5-1f5311d18c7b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:51.522680 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-98cf05d1-fbc4-4c15-8fa5-1f5311d18c7b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:51.530126 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-98cf05d1-fbc4-4c15-8fa5-1f5311d18c7b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1307 microversion: 2.1 time: 0.135141 Apr 12 00:33:51.530852 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 442/858] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:51 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1307 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:52.546965 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-fada34cb-95a7-4543-9f6c-e4a05ebd9e0f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:52.547624 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-fada34cb-95a7-4543-9f6c-e4a05ebd9e0f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:52.554197 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fada34cb-95a7-4543-9f6c-e4a05ebd9e0f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:52.554849 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fada34cb-95a7-4543-9f6c-e4a05ebd9e0f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:52.556217 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fada34cb-95a7-4543-9f6c-e4a05ebd9e0f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:52.556517 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fada34cb-95a7-4543-9f6c-e4a05ebd9e0f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:53.041909 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-fada34cb-95a7-4543-9f6c-e4a05ebd9e0f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:53.056422 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-fada34cb-95a7-4543-9f6c-e4a05ebd9e0f tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1363 microversion: 2.1 time: 0.513243 Apr 12 00:33:53.064325 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 417/859] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:52 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1363 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:53.271507 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-b9d1f766-0b0b-43b0-b90a-3ac0eeafd501 req-e0e33954-8ae2-4bf8-8979-0cd4750bb470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9b5894e-894a-440c-b868-3df0c388fda0", "tag": "4c6b1ac0-8e24-4c16-a4d3-c8ccd6876629"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:53.291002 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-b9d1f766-0b0b-43b0-b90a-3ac0eeafd501 req-e0e33954-8ae2-4bf8-8979-0cd4750bb470 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:53.291595 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-b9d1f766-0b0b-43b0-b90a-3ac0eeafd501 req-e0e33954-8ae2-4bf8-8979-0cd4750bb470 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:53.303893 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-b9d1f766-0b0b-43b0-b90a-3ac0eeafd501 req-e0e33954-8ae2-4bf8-8979-0cd4750bb470 service nova] Creating event network-changed:4c6b1ac0-8e24-4c16-a4d3-c8ccd6876629 for instance d9b5894e-894a-440c-b868-3df0c388fda0 on hv-cinder-83625 Apr 12 00:33:53.309332 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-b9d1f766-0b0b-43b0-b90a-3ac0eeafd501 req-e0e33954-8ae2-4bf8-8979-0cd4750bb470 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041847 Apr 12 00:33:53.314770 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 443/860] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:53.399629 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e6fe02f8-7c28-46f0-87a1-0b417a38a3fa tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:53.400200 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e6fe02f8-7c28-46f0-87a1-0b417a38a3fa tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:53.406513 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e6fe02f8-7c28-46f0-87a1-0b417a38a3fa tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:53.406926 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e6fe02f8-7c28-46f0-87a1-0b417a38a3fa tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:53.407701 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e6fe02f8-7c28-46f0-87a1-0b417a38a3fa tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:53.408130 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e6fe02f8-7c28-46f0-87a1-0b417a38a3fa tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:53.438343 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e6fe02f8-7c28-46f0-87a1-0b417a38a3fa tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Going to try to terminate instance {{(pid=128487) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:33:53.540302 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e6fe02f8-7c28-46f0-87a1-0b417a38a3fa tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 204 len: 0 microversion: 2.1 time: 0.144289 Apr 12 00:33:53.541252 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 418/861] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:33:53 2022] DELETE /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:33:53.549503 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-100840ca-a76d-4fa3-82b3-a0badf65fa36 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:53.550722 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-100840ca-a76d-4fa3-82b3-a0badf65fa36 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:53.559021 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-100840ca-a76d-4fa3-82b3-a0badf65fa36 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:53.559744 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-100840ca-a76d-4fa3-82b3-a0badf65fa36 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:53.560507 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-100840ca-a76d-4fa3-82b3-a0badf65fa36 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:53.561137 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-100840ca-a76d-4fa3-82b3-a0badf65fa36 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:53.698336 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-100840ca-a76d-4fa3-82b3-a0badf65fa36 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:53.705753 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-100840ca-a76d-4fa3-82b3-a0badf65fa36 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1578 microversion: 2.1 time: 0.160255 Apr 12 00:33:53.706226 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 444/862] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:53 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:54.073334 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-97ecc81e-7a54-4a9c-b777-15be550b58f4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:54.074026 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-97ecc81e-7a54-4a9c-b777-15be550b58f4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:54.081069 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-97ecc81e-7a54-4a9c-b777-15be550b58f4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:54.081526 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-97ecc81e-7a54-4a9c-b777-15be550b58f4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:54.082303 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-97ecc81e-7a54-4a9c-b777-15be550b58f4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:54.082909 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-97ecc81e-7a54-4a9c-b777-15be550b58f4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:54.216755 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-97ecc81e-7a54-4a9c-b777-15be550b58f4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:54.224529 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-97ecc81e-7a54-4a9c-b777-15be550b58f4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1363 microversion: 2.1 time: 0.155271 Apr 12 00:33:54.225094 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 419/863] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:54 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:54.723516 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-04c54b4e-6ff5-46ce-9fe1-8726132b0193 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:54.724125 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-04c54b4e-6ff5-46ce-9fe1-8726132b0193 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:54.730397 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-04c54b4e-6ff5-46ce-9fe1-8726132b0193 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:54.730843 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-04c54b4e-6ff5-46ce-9fe1-8726132b0193 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:54.731602 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-04c54b4e-6ff5-46ce-9fe1-8726132b0193 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:54.732034 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-04c54b4e-6ff5-46ce-9fe1-8726132b0193 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:54.857678 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-04c54b4e-6ff5-46ce-9fe1-8726132b0193 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:54.864919 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-04c54b4e-6ff5-46ce-9fe1-8726132b0193 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1578 microversion: 2.1 time: 0.145927 Apr 12 00:33:54.865486 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 445/864] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:54 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1578 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:55.240673 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b6b6f9cb-55c7-49c8-b767-00d2aadfc3f0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:55.241343 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b6b6f9cb-55c7-49c8-b767-00d2aadfc3f0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:55.247596 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b6b6f9cb-55c7-49c8-b767-00d2aadfc3f0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:55.248115 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b6b6f9cb-55c7-49c8-b767-00d2aadfc3f0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:55.249045 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b6b6f9cb-55c7-49c8-b767-00d2aadfc3f0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:55.254767 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b6b6f9cb-55c7-49c8-b767-00d2aadfc3f0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:55.380974 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b6b6f9cb-55c7-49c8-b767-00d2aadfc3f0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:55.390831 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b6b6f9cb-55c7-49c8-b767-00d2aadfc3f0 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1363 microversion: 2.1 time: 0.153426 Apr 12 00:33:55.392174 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 420/865] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:55 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:55.883606 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-602e9158-64d6-4b5f-b2b7-cf2ee71e3eb7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:55.884219 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-602e9158-64d6-4b5f-b2b7-cf2ee71e3eb7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:55.890560 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-602e9158-64d6-4b5f-b2b7-cf2ee71e3eb7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:55.891007 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-602e9158-64d6-4b5f-b2b7-cf2ee71e3eb7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:55.892034 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-602e9158-64d6-4b5f-b2b7-cf2ee71e3eb7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:55.892469 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-602e9158-64d6-4b5f-b2b7-cf2ee71e3eb7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:56.020890 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-602e9158-64d6-4b5f-b2b7-cf2ee71e3eb7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:56.028333 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-602e9158-64d6-4b5f-b2b7-cf2ee71e3eb7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1578 microversion: 2.1 time: 0.148501 Apr 12 00:33:56.028907 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 446/866] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:55 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:56.408369 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-35eb98ea-5813-4bfd-9690-a31df0eb6fdb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:56.408949 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-35eb98ea-5813-4bfd-9690-a31df0eb6fdb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:56.415234 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35eb98ea-5813-4bfd-9690-a31df0eb6fdb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:56.415694 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35eb98ea-5813-4bfd-9690-a31df0eb6fdb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:56.416451 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35eb98ea-5813-4bfd-9690-a31df0eb6fdb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:56.416882 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-35eb98ea-5813-4bfd-9690-a31df0eb6fdb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:56.541091 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-35eb98ea-5813-4bfd-9690-a31df0eb6fdb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:56.548159 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-35eb98ea-5813-4bfd-9690-a31df0eb6fdb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1363 microversion: 2.1 time: 0.143713 Apr 12 00:33:56.548720 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 421/867] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:56 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:57.045159 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4174fa47-f982-4041-9c2d-6227245c6064 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:57.045783 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4174fa47-f982-4041-9c2d-6227245c6064 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:57.052215 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4174fa47-f982-4041-9c2d-6227245c6064 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:57.052671 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4174fa47-f982-4041-9c2d-6227245c6064 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:57.053445 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4174fa47-f982-4041-9c2d-6227245c6064 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:57.053887 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4174fa47-f982-4041-9c2d-6227245c6064 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:57.185734 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4174fa47-f982-4041-9c2d-6227245c6064 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:57.193652 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4174fa47-f982-4041-9c2d-6227245c6064 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1578 microversion: 2.1 time: 0.152614 Apr 12 00:33:57.194220 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 447/868] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:57 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:57.565090 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d0a1907c-0ceb-4da7-893d-5054cdc7af74 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:57.565821 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d0a1907c-0ceb-4da7-893d-5054cdc7af74 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:57.572067 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d0a1907c-0ceb-4da7-893d-5054cdc7af74 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:57.572509 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d0a1907c-0ceb-4da7-893d-5054cdc7af74 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:57.573272 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d0a1907c-0ceb-4da7-893d-5054cdc7af74 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:57.573699 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d0a1907c-0ceb-4da7-893d-5054cdc7af74 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:57.751851 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d0a1907c-0ceb-4da7-893d-5054cdc7af74 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:57.762435 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d0a1907c-0ceb-4da7-893d-5054cdc7af74 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1363 microversion: 2.1 time: 0.201150 Apr 12 00:33:57.763012 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 422/869] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:57 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:58.212724 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-6aee0633-cada-488b-8e2b-883d2f7ea2db tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:58.215826 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-6aee0633-cada-488b-8e2b-883d2f7ea2db tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:58.229913 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6aee0633-cada-488b-8e2b-883d2f7ea2db tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:58.230774 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6aee0633-cada-488b-8e2b-883d2f7ea2db tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:58.231798 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6aee0633-cada-488b-8e2b-883d2f7ea2db tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:58.232337 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-6aee0633-cada-488b-8e2b-883d2f7ea2db tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:58.376752 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-6aee0633-cada-488b-8e2b-883d2f7ea2db tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:58.394007 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-6aee0633-cada-488b-8e2b-883d2f7ea2db tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1578 microversion: 2.1 time: 0.186144 Apr 12 00:33:58.398119 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 448/870] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:58 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1578 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:58.780063 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9a33e123-0579-48fc-a1f9-5d8bf945fbb1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:58.780680 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-9a33e123-0579-48fc-a1f9-5d8bf945fbb1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:58.787418 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9a33e123-0579-48fc-a1f9-5d8bf945fbb1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:58.787865 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9a33e123-0579-48fc-a1f9-5d8bf945fbb1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:58.788627 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9a33e123-0579-48fc-a1f9-5d8bf945fbb1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:58.789059 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9a33e123-0579-48fc-a1f9-5d8bf945fbb1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:59.037306 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9a33e123-0579-48fc-a1f9-5d8bf945fbb1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:59.046819 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9a33e123-0579-48fc-a1f9-5d8bf945fbb1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1363 microversion: 2.1 time: 0.270647 Apr 12 00:33:59.058817 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-f6929442-37fe-4faf-a5ea-39d70e0931ac req-9fbabb6c-dbbb-4a5d-9547-83c2c35ca3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e46194d7-3e05-4313-b0ca-4ec9cee517f8", "name": "network-vif-deleted", "tag": "2ccdca9b-24da-4065-b499-5447b18262ad"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:59.066505 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 423/871] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:58 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:59.070071 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-f6929442-37fe-4faf-a5ea-39d70e0931ac req-9fbabb6c-dbbb-4a5d-9547-83c2c35ca3b4 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:59.070550 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-f6929442-37fe-4faf-a5ea-39d70e0931ac req-9fbabb6c-dbbb-4a5d-9547-83c2c35ca3b4 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:59.083356 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-f6929442-37fe-4faf-a5ea-39d70e0931ac req-9fbabb6c-dbbb-4a5d-9547-83c2c35ca3b4 service nova] Creating event network-vif-deleted:2ccdca9b-24da-4065-b499-5447b18262ad for instance e46194d7-3e05-4313-b0ca-4ec9cee517f8 on hv-cinder-83625 Apr 12 00:33:59.089305 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-f6929442-37fe-4faf-a5ea-39d70e0931ac req-9fbabb6c-dbbb-4a5d-9547-83c2c35ca3b4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044903 Apr 12 00:33:59.094330 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 449/872] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:33:59.416448 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3397e34e-40a7-4a47-bb83-d60a0c0b37f1 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:59.417164 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3397e34e-40a7-4a47-bb83-d60a0c0b37f1 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:33:59.424429 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3397e34e-40a7-4a47-bb83-d60a0c0b37f1 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:59.425205 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3397e34e-40a7-4a47-bb83-d60a0c0b37f1 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:59.426453 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3397e34e-40a7-4a47-bb83-d60a0c0b37f1 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:59.427094 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3397e34e-40a7-4a47-bb83-d60a0c0b37f1 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:59.517605 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-3397e34e-40a7-4a47-bb83-d60a0c0b37f1 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:33:59.526139 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3397e34e-40a7-4a47-bb83-d60a0c0b37f1 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 200 len: 1225 microversion: 2.1 time: 0.114945 Apr 12 00:33:59.527110 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 424/873] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:33:59 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:59.840850 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-d476f3f1-6c76-4491-8231-7307fd402141 req-7973ce96-d8e0-419b-9324-d326b20174a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b5894e-894a-440c-b868-3df0c388fda0", "name": "network-vif-plugged", "status": "completed", "tag": "4c6b1ac0-8e24-4c16-a4d3-c8ccd6876629"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:59.849477 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-d476f3f1-6c76-4491-8231-7307fd402141 req-7973ce96-d8e0-419b-9324-d326b20174a2 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:33:59.849924 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-d476f3f1-6c76-4491-8231-7307fd402141 req-7973ce96-d8e0-419b-9324-d326b20174a2 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:33:59.861043 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-d476f3f1-6c76-4491-8231-7307fd402141 req-7973ce96-d8e0-419b-9324-d326b20174a2 service nova] Creating event network-vif-plugged:4c6b1ac0-8e24-4c16-a4d3-c8ccd6876629 for instance d9b5894e-894a-440c-b868-3df0c388fda0 on hv-cinder-83625 Apr 12 00:33:59.869381 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-d476f3f1-6c76-4491-8231-7307fd402141 req-7973ce96-d8e0-419b-9324-d326b20174a2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032582 Apr 12 00:33:59.870665 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 450/874] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:00.065392 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c330d9d6-909b-4ca7-8d4f-41b26a8936b7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:00.066749 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c330d9d6-909b-4ca7-8d4f-41b26a8936b7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:00.074692 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c330d9d6-909b-4ca7-8d4f-41b26a8936b7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:00.076106 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c330d9d6-909b-4ca7-8d4f-41b26a8936b7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:00.077286 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c330d9d6-909b-4ca7-8d4f-41b26a8936b7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:00.078388 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c330d9d6-909b-4ca7-8d4f-41b26a8936b7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:00.239841 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c330d9d6-909b-4ca7-8d4f-41b26a8936b7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:00.246923 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c330d9d6-909b-4ca7-8d4f-41b26a8936b7 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1363 microversion: 2.1 time: 0.185595 Apr 12 00:34:00.247482 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 425/875] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:00 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:00.544112 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e4baf36f-6a5e-4b05-ab8d-187df3db07ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:00.544904 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e4baf36f-6a5e-4b05-ab8d-187df3db07ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:00.551633 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e4baf36f-6a5e-4b05-ab8d-187df3db07ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:00.552094 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e4baf36f-6a5e-4b05-ab8d-187df3db07ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:00.552882 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e4baf36f-6a5e-4b05-ab8d-187df3db07ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:00.553325 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e4baf36f-6a5e-4b05-ab8d-187df3db07ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:00.566796 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-e4baf36f-6a5e-4b05-ab8d-187df3db07ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] HTTP exception thrown: Instance e46194d7-3e05-4313-b0ca-4ec9cee517f8 could not be found. Apr 12 00:34:00.567390 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e4baf36f-6a5e-4b05-ab8d-187df3db07ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Returning 404 to user: Instance e46194d7-3e05-4313-b0ca-4ec9cee517f8 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:34:00.568195 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e4baf36f-6a5e-4b05-ab8d-187df3db07ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 404 len: 111 microversion: 2.1 time: 0.028581 Apr 12 00:34:00.568729 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 451/876] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:00 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:34:00.667441 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-7e502999-7887-4e04-ada6-c5755c264073 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2077448424", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-989695835", "security_groups": [{"name": "tempest-secgroup-smoke-1352959982"}], "block_device_mapping_v2": [{"uuid": "1bbab0a7-cd7a-4f10-b266-f9b0531ae424", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8a9865c2-0d03-40f9-a71a-607e87040674"}]}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:00.779014 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.network.neutron [None req-7e502999-7887-4e04-ada6-c5755c264073 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] validate_networks() for [('8a9865c2-0d03-40f9-a71a-607e87040674', None, None, None, None, None)] {{(pid=128487) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:34:01.133511 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-7e502999-7887-4e04-ada6-c5755c264073 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Flavor limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:34:01.134020 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-7e502999-7887-4e04-ada6-c5755c264073 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Image limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:34:01.134448 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-7e502999-7887-4e04-ada6-c5755c264073 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Flavor pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:34:01.134854 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-7e502999-7887-4e04-ada6-c5755c264073 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Image pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:34:01.135261 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-7e502999-7887-4e04-ada6-c5755c264073 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:34:01.144584 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7e502999-7887-4e04-ada6-c5755c264073 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:01.145033 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7e502999-7887-4e04-ada6-c5755c264073 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:01.145835 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7e502999-7887-4e04-ada6-c5755c264073 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:01.146285 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7e502999-7887-4e04-ada6-c5755c264073 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:01.162568 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-7e502999-7887-4e04-ada6-c5755c264073 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Getting quotas for project 4ad54dac63374c8a9b4da55ee5dc7fd1. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:34:01.166508 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-7e502999-7887-4e04-ada6-c5755c264073 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Getting quotas for user 3b1d212dad5347a888832a779beadece and project 4ad54dac63374c8a9b4da55ee5dc7fd1. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:34:01.220452 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-7e502999-7887-4e04-ada6-c5755c264073 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Going to run 1 instances... {{(pid=128487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:34:01.223073 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-7e502999-7887-4e04-ada6-c5755c264073 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1bbab0a7-cd7a-4f10-b266-f9b0531ae424',volume_size=None,volume_type=None)] {{(pid=128487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:34:01.263913 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-45e78888-96c1-4311-a473-c12dcfbe1c52 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:01.264524 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-45e78888-96c1-4311-a473-c12dcfbe1c52 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:01.271810 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-45e78888-96c1-4311-a473-c12dcfbe1c52 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:01.272254 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-45e78888-96c1-4311-a473-c12dcfbe1c52 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:01.273014 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-45e78888-96c1-4311-a473-c12dcfbe1c52 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:01.273449 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-45e78888-96c1-4311-a473-c12dcfbe1c52 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:01.345135 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-7e502999-7887-4e04-ada6-c5755c264073 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.681721 Apr 12 00:34:01.345790 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 426/877] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:34:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:34:01.355391 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-43934b7c-b226-41d2-a168-61d627454526 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:01.355997 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-43934b7c-b226-41d2-a168-61d627454526 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:01.409635 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-43934b7c-b226-41d2-a168-61d627454526 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:01.417579 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-43934b7c-b226-41d2-a168-61d627454526 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1094 microversion: 2.1 time: 0.065841 Apr 12 00:34:01.419514 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-45e78888-96c1-4311-a473-c12dcfbe1c52 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:01.427869 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 427/878] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:01 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:34:01.428573 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-45e78888-96c1-4311-a473-c12dcfbe1c52 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1363 microversion: 2.1 time: 0.167939 Apr 12 00:34:01.429507 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 452/879] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:01 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:34:02.434734 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-04a94da8-eee8-48f0-9bc3-5bdb47288c6c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:02.435319 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-04a94da8-eee8-48f0-9bc3-5bdb47288c6c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:02.441908 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-04a94da8-eee8-48f0-9bc3-5bdb47288c6c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:02.442383 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-04a94da8-eee8-48f0-9bc3-5bdb47288c6c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:02.443171 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-04a94da8-eee8-48f0-9bc3-5bdb47288c6c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:02.443607 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-04a94da8-eee8-48f0-9bc3-5bdb47288c6c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:02.444547 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-98bb0bc1-9457-422c-ba85-bf2a3a9517f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:02.445155 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-98bb0bc1-9457-422c-ba85-bf2a3a9517f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:02.451286 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-98bb0bc1-9457-422c-ba85-bf2a3a9517f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:02.451735 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-98bb0bc1-9457-422c-ba85-bf2a3a9517f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:02.452493 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-98bb0bc1-9457-422c-ba85-bf2a3a9517f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:02.452927 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-98bb0bc1-9457-422c-ba85-bf2a3a9517f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:02.507616 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-04a94da8-eee8-48f0-9bc3-5bdb47288c6c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:02.514866 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-04a94da8-eee8-48f0-9bc3-5bdb47288c6c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1144 microversion: 2.1 time: 0.083953 Apr 12 00:34:02.515441 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 428/880] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:02 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:02.576219 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-98bb0bc1-9457-422c-ba85-bf2a3a9517f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:02.583990 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-98bb0bc1-9457-422c-ba85-bf2a3a9517f1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1363 microversion: 2.1 time: 0.143184 Apr 12 00:34:02.584577 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 453/881] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:02 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:34:03.531956 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-aacc65ea-d93c-45fd-a819-97c3b8d94dc4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:03.532568 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-aacc65ea-d93c-45fd-a819-97c3b8d94dc4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:03.539383 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-aacc65ea-d93c-45fd-a819-97c3b8d94dc4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:03.539832 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-aacc65ea-d93c-45fd-a819-97c3b8d94dc4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:03.540595 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-aacc65ea-d93c-45fd-a819-97c3b8d94dc4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:03.541029 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-aacc65ea-d93c-45fd-a819-97c3b8d94dc4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:03.600623 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-aacc65ea-d93c-45fd-a819-97c3b8d94dc4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:03.601225 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1991bd7a-9ab0-461e-a0ca-8a70c7d13c23 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:03.601838 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1991bd7a-9ab0-461e-a0ca-8a70c7d13c23 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:03.607905 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-aacc65ea-d93c-45fd-a819-97c3b8d94dc4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1144 microversion: 2.1 time: 0.079779 Apr 12 00:34:03.608169 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1991bd7a-9ab0-461e-a0ca-8a70c7d13c23 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:03.608476 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 429/882] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:03 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:03.608607 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1991bd7a-9ab0-461e-a0ca-8a70c7d13c23 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:03.609452 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1991bd7a-9ab0-461e-a0ca-8a70c7d13c23 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:03.609960 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1991bd7a-9ab0-461e-a0ca-8a70c7d13c23 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:03.735036 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1991bd7a-9ab0-461e-a0ca-8a70c7d13c23 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:03.743052 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1991bd7a-9ab0-461e-a0ca-8a70c7d13c23 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1363 microversion: 2.1 time: 0.145690 Apr 12 00:34:03.743615 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 454/883] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:03 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:34:04.624504 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a848ded3-cfb5-4f69-89c1-ba4e090bdb94 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:04.625111 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a848ded3-cfb5-4f69-89c1-ba4e090bdb94 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:04.631932 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a848ded3-cfb5-4f69-89c1-ba4e090bdb94 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:04.632377 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a848ded3-cfb5-4f69-89c1-ba4e090bdb94 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:04.633235 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a848ded3-cfb5-4f69-89c1-ba4e090bdb94 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:04.633613 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a848ded3-cfb5-4f69-89c1-ba4e090bdb94 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:04.696696 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a848ded3-cfb5-4f69-89c1-ba4e090bdb94 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:04.704206 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a848ded3-cfb5-4f69-89c1-ba4e090bdb94 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1136 microversion: 2.1 time: 0.083513 Apr 12 00:34:04.704771 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 430/884] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:04 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:04.759405 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5ac8b449-66d0-499f-843b-20ab91ffa111 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:04.760227 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5ac8b449-66d0-499f-843b-20ab91ffa111 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:04.766611 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5ac8b449-66d0-499f-843b-20ab91ffa111 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:04.767061 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5ac8b449-66d0-499f-843b-20ab91ffa111 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:04.767822 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5ac8b449-66d0-499f-843b-20ab91ffa111 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:04.768252 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5ac8b449-66d0-499f-843b-20ab91ffa111 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:04.894660 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5ac8b449-66d0-499f-843b-20ab91ffa111 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:04.902055 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5ac8b449-66d0-499f-843b-20ab91ffa111 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1363 microversion: 2.1 time: 0.146534 Apr 12 00:34:04.903089 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 455/885] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:04 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:05.721340 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-85ee2c40-a9f2-4694-a567-a33d701fe5c1 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:05.721956 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-85ee2c40-a9f2-4694-a567-a33d701fe5c1 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:05.728407 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-85ee2c40-a9f2-4694-a567-a33d701fe5c1 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:05.728854 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-85ee2c40-a9f2-4694-a567-a33d701fe5c1 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:05.729616 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-85ee2c40-a9f2-4694-a567-a33d701fe5c1 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:05.730052 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-85ee2c40-a9f2-4694-a567-a33d701fe5c1 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:05.828041 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-85ee2c40-a9f2-4694-a567-a33d701fe5c1 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:05.836485 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-85ee2c40-a9f2-4694-a567-a33d701fe5c1 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1200 microversion: 2.1 time: 0.119473 Apr 12 00:34:05.837329 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 431/886] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:05 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1200 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:05.920690 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f425fdaa-6437-4b6c-90d3-0274ce9ae293 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:05.921304 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f425fdaa-6437-4b6c-90d3-0274ce9ae293 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:05.927920 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f425fdaa-6437-4b6c-90d3-0274ce9ae293 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:05.928503 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f425fdaa-6437-4b6c-90d3-0274ce9ae293 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:05.929358 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f425fdaa-6437-4b6c-90d3-0274ce9ae293 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:05.929802 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f425fdaa-6437-4b6c-90d3-0274ce9ae293 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:06.091827 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f425fdaa-6437-4b6c-90d3-0274ce9ae293 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:06.100575 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f425fdaa-6437-4b6c-90d3-0274ce9ae293 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1550 microversion: 2.1 time: 0.183911 Apr 12 00:34:06.101451 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 456/887] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:05 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1550 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:06.123074 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4d996c77-e521-4d33-b42d-90342f2e00ea tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:06.123995 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-4d996c77-e521-4d33-b42d-90342f2e00ea tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:06.133224 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4d996c77-e521-4d33-b42d-90342f2e00ea tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:06.134042 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4d996c77-e521-4d33-b42d-90342f2e00ea tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:06.135053 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4d996c77-e521-4d33-b42d-90342f2e00ea tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:06.135693 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4d996c77-e521-4d33-b42d-90342f2e00ea tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:06.253570 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-4d996c77-e521-4d33-b42d-90342f2e00ea tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.138957 Apr 12 00:34:06.254166 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 432/888] 10.222.0.32 () {58 vars in 1274 bytes} [Tue Apr 12 00:34:06 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:06.853930 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-d6ed78e2-e428-4f1c-aa05-a82426948c7d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:06.854582 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-d6ed78e2-e428-4f1c-aa05-a82426948c7d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:06.860414 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d6ed78e2-e428-4f1c-aa05-a82426948c7d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:06.860872 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d6ed78e2-e428-4f1c-aa05-a82426948c7d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:06.862175 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d6ed78e2-e428-4f1c-aa05-a82426948c7d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:06.862645 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d6ed78e2-e428-4f1c-aa05-a82426948c7d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:07.115388 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-d6ed78e2-e428-4f1c-aa05-a82426948c7d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:07.124271 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-d6ed78e2-e428-4f1c-aa05-a82426948c7d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1266 microversion: 2.1 time: 0.274171 Apr 12 00:34:07.125427 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 457/889] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:06 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:34:07.330924 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-080ff568-6cd2-416e-b7ca-7b7c325454a4 req-6842664e-0fba-454a-b5b3-8a320f1be401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a3357fa-5beb-40ae-ba19-95e893acd4b8", "tag": "eacce356-7ace-426f-a907-2db9bedc490d"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:07.348154 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-080ff568-6cd2-416e-b7ca-7b7c325454a4 req-6842664e-0fba-454a-b5b3-8a320f1be401 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:07.349096 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-080ff568-6cd2-416e-b7ca-7b7c325454a4 req-6842664e-0fba-454a-b5b3-8a320f1be401 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:07.366115 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-080ff568-6cd2-416e-b7ca-7b7c325454a4 req-6842664e-0fba-454a-b5b3-8a320f1be401 service nova] Creating event network-changed:eacce356-7ace-426f-a907-2db9bedc490d for instance 4a3357fa-5beb-40ae-ba19-95e893acd4b8 on hv-cinder-83625 Apr 12 00:34:07.372204 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-080ff568-6cd2-416e-b7ca-7b7c325454a4 req-6842664e-0fba-454a-b5b3-8a320f1be401 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045795 Apr 12 00:34:07.373432 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 433/890] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:07.617423 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-e2dfdc09-36f3-4a23-937f-733d9cfbe4b7 req-c5999a78-0ea8-4392-ab25-de3daf76f19c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9b5894e-894a-440c-b868-3df0c388fda0", "tag": "4c6b1ac0-8e24-4c16-a4d3-c8ccd6876629"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:07.627868 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-e2dfdc09-36f3-4a23-937f-733d9cfbe4b7 req-c5999a78-0ea8-4392-ab25-de3daf76f19c service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:07.628316 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-e2dfdc09-36f3-4a23-937f-733d9cfbe4b7 req-c5999a78-0ea8-4392-ab25-de3daf76f19c service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:07.642218 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-e2dfdc09-36f3-4a23-937f-733d9cfbe4b7 req-c5999a78-0ea8-4392-ab25-de3daf76f19c service nova] Creating event network-changed:4c6b1ac0-8e24-4c16-a4d3-c8ccd6876629 for instance d9b5894e-894a-440c-b868-3df0c388fda0 on hv-cinder-83625 Apr 12 00:34:07.648597 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-e2dfdc09-36f3-4a23-937f-733d9cfbe4b7 req-c5999a78-0ea8-4392-ab25-de3daf76f19c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035184 Apr 12 00:34:07.649338 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 458/891] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:08.142902 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d96fc1d6-2645-4a81-bba2-bd8ed77b234c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:08.143601 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d96fc1d6-2645-4a81-bba2-bd8ed77b234c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:08.149849 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d96fc1d6-2645-4a81-bba2-bd8ed77b234c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:08.150535 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d96fc1d6-2645-4a81-bba2-bd8ed77b234c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:08.151484 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d96fc1d6-2645-4a81-bba2-bd8ed77b234c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:08.151912 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d96fc1d6-2645-4a81-bba2-bd8ed77b234c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:08.336497 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d96fc1d6-2645-4a81-bba2-bd8ed77b234c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:08.344333 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d96fc1d6-2645-4a81-bba2-bd8ed77b234c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1266 microversion: 2.1 time: 0.205932 Apr 12 00:34:08.344893 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 434/892] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:08 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:09.363109 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-889ea5ca-cf20-4cfe-9928-c9cf4aa4e474 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:09.363828 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-889ea5ca-cf20-4cfe-9928-c9cf4aa4e474 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:09.369843 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-889ea5ca-cf20-4cfe-9928-c9cf4aa4e474 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:09.370204 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-889ea5ca-cf20-4cfe-9928-c9cf4aa4e474 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:09.370994 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-889ea5ca-cf20-4cfe-9928-c9cf4aa4e474 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:09.371425 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-889ea5ca-cf20-4cfe-9928-c9cf4aa4e474 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:09.516866 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-889ea5ca-cf20-4cfe-9928-c9cf4aa4e474 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:09.527798 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-889ea5ca-cf20-4cfe-9928-c9cf4aa4e474 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1266 microversion: 2.1 time: 0.170513 Apr 12 00:34:09.529162 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 459/893] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:09 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:34:10.545813 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-84755a76-bd0f-4edc-b2d1-90591dc51191 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:10.546351 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-84755a76-bd0f-4edc-b2d1-90591dc51191 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:10.553164 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-84755a76-bd0f-4edc-b2d1-90591dc51191 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:10.553617 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-84755a76-bd0f-4edc-b2d1-90591dc51191 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:10.554395 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-84755a76-bd0f-4edc-b2d1-90591dc51191 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:10.554826 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-84755a76-bd0f-4edc-b2d1-90591dc51191 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:10.680775 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-84755a76-bd0f-4edc-b2d1-90591dc51191 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:10.687889 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-84755a76-bd0f-4edc-b2d1-90591dc51191 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1266 microversion: 2.1 time: 0.146124 Apr 12 00:34:10.688451 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 435/894] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:10 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:11.704885 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-44b1f666-2837-4ed5-910f-83dd914ea9cd tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:11.705525 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-44b1f666-2837-4ed5-910f-83dd914ea9cd tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:11.711789 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-44b1f666-2837-4ed5-910f-83dd914ea9cd tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:11.712237 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-44b1f666-2837-4ed5-910f-83dd914ea9cd tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:11.712995 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-44b1f666-2837-4ed5-910f-83dd914ea9cd tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:11.713427 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-44b1f666-2837-4ed5-910f-83dd914ea9cd tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:11.841806 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-44b1f666-2837-4ed5-910f-83dd914ea9cd tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:11.849630 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-44b1f666-2837-4ed5-910f-83dd914ea9cd tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1266 microversion: 2.1 time: 0.148579 Apr 12 00:34:11.850185 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 460/895] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:11 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:12.866324 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3a570f83-c104-4c19-968a-fec7d286d57c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:12.866928 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3a570f83-c104-4c19-968a-fec7d286d57c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:12.873209 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3a570f83-c104-4c19-968a-fec7d286d57c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:12.873676 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3a570f83-c104-4c19-968a-fec7d286d57c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:12.874455 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3a570f83-c104-4c19-968a-fec7d286d57c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:12.874899 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3a570f83-c104-4c19-968a-fec7d286d57c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:13.002341 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-3a570f83-c104-4c19-968a-fec7d286d57c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:13.009456 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3a570f83-c104-4c19-968a-fec7d286d57c tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1266 microversion: 2.1 time: 0.147018 Apr 12 00:34:13.010028 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 436/896] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:12 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:14.026950 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8a675a73-5bd4-41fe-a8f0-397003d43d96 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:14.027495 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8a675a73-5bd4-41fe-a8f0-397003d43d96 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:14.033833 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8a675a73-5bd4-41fe-a8f0-397003d43d96 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:14.034310 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8a675a73-5bd4-41fe-a8f0-397003d43d96 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:14.035095 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8a675a73-5bd4-41fe-a8f0-397003d43d96 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:14.035527 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8a675a73-5bd4-41fe-a8f0-397003d43d96 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:14.161216 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8a675a73-5bd4-41fe-a8f0-397003d43d96 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:14.168460 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8a675a73-5bd4-41fe-a8f0-397003d43d96 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1266 microversion: 2.1 time: 0.145435 Apr 12 00:34:14.169025 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 461/897] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:14 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:15.185393 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a34db754-a12a-4b00-b1bf-2f038962d7d6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:15.186000 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a34db754-a12a-4b00-b1bf-2f038962d7d6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:15.192883 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a34db754-a12a-4b00-b1bf-2f038962d7d6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:15.193333 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a34db754-a12a-4b00-b1bf-2f038962d7d6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:15.194091 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a34db754-a12a-4b00-b1bf-2f038962d7d6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:15.194560 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a34db754-a12a-4b00-b1bf-2f038962d7d6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:15.321902 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a34db754-a12a-4b00-b1bf-2f038962d7d6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:15.329017 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a34db754-a12a-4b00-b1bf-2f038962d7d6 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1266 microversion: 2.1 time: 0.147425 Apr 12 00:34:15.329579 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 437/898] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:15 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:16.344877 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-af9bc78d-6cbd-4f89-99ad-553a4f93aa26 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:16.346142 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-af9bc78d-6cbd-4f89-99ad-553a4f93aa26 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:16.352619 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-af9bc78d-6cbd-4f89-99ad-553a4f93aa26 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:16.353074 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-af9bc78d-6cbd-4f89-99ad-553a4f93aa26 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:16.353847 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-af9bc78d-6cbd-4f89-99ad-553a4f93aa26 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:16.354318 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-af9bc78d-6cbd-4f89-99ad-553a4f93aa26 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:16.480114 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-af9bc78d-6cbd-4f89-99ad-553a4f93aa26 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:16.487891 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-af9bc78d-6cbd-4f89-99ad-553a4f93aa26 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1266 microversion: 2.1 time: 0.146927 Apr 12 00:34:16.488457 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 462/899] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:16 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:17.505208 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d13ebe3c-534e-49d2-b9cc-7dab267b685e tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:17.505815 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d13ebe3c-534e-49d2-b9cc-7dab267b685e tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:17.512093 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d13ebe3c-534e-49d2-b9cc-7dab267b685e tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:17.512531 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d13ebe3c-534e-49d2-b9cc-7dab267b685e tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:17.513280 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d13ebe3c-534e-49d2-b9cc-7dab267b685e tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:17.513709 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d13ebe3c-534e-49d2-b9cc-7dab267b685e tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:17.645909 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d13ebe3c-534e-49d2-b9cc-7dab267b685e tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:17.653891 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d13ebe3c-534e-49d2-b9cc-7dab267b685e tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1266 microversion: 2.1 time: 0.153036 Apr 12 00:34:17.654754 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 438/900] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:17 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:17.772890 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3bd29e4b-fef5-4ce5-a800-37d09aab75ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:17.773424 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3bd29e4b-fef5-4ce5-a800-37d09aab75ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:17.779760 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3bd29e4b-fef5-4ce5-a800-37d09aab75ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:17.780214 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3bd29e4b-fef5-4ce5-a800-37d09aab75ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:17.780968 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3bd29e4b-fef5-4ce5-a800-37d09aab75ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:17.781400 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3bd29e4b-fef5-4ce5-a800-37d09aab75ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:17.804272 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3bd29e4b-fef5-4ce5-a800-37d09aab75ad tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29/ips" status: 200 len: 151 microversion: 2.20 time: 0.035241 Apr 12 00:34:17.804847 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 463/901] 10.222.0.32 () {60 vars in 1288 bytes} [Tue Apr 12 00:34:17 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:34:18.671444 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1597d674-7101-4ce8-af56-3212fc63c576 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:18.672056 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1597d674-7101-4ce8-af56-3212fc63c576 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:18.678333 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1597d674-7101-4ce8-af56-3212fc63c576 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:18.678783 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1597d674-7101-4ce8-af56-3212fc63c576 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:18.679537 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1597d674-7101-4ce8-af56-3212fc63c576 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:18.679968 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1597d674-7101-4ce8-af56-3212fc63c576 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:18.810571 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1597d674-7101-4ce8-af56-3212fc63c576 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:18.817897 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1597d674-7101-4ce8-af56-3212fc63c576 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1266 microversion: 2.1 time: 0.150274 Apr 12 00:34:18.818488 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 439/902] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:18 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:19.834786 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2d699e12-5326-4507-8516-98c79bf42807 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:19.835422 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-2d699e12-5326-4507-8516-98c79bf42807 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:19.841626 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2d699e12-5326-4507-8516-98c79bf42807 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:19.842073 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2d699e12-5326-4507-8516-98c79bf42807 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:19.842868 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2d699e12-5326-4507-8516-98c79bf42807 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:19.843308 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2d699e12-5326-4507-8516-98c79bf42807 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:19.975122 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2d699e12-5326-4507-8516-98c79bf42807 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:19.982437 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2d699e12-5326-4507-8516-98c79bf42807 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1266 microversion: 2.1 time: 0.151569 Apr 12 00:34:19.983027 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 464/903] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:19 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:20.999293 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-dbd383f1-0b5b-4b37-8ba9-cab4724f6590 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:20.999900 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-dbd383f1-0b5b-4b37-8ba9-cab4724f6590 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:21.006217 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dbd383f1-0b5b-4b37-8ba9-cab4724f6590 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:21.006696 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dbd383f1-0b5b-4b37-8ba9-cab4724f6590 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:21.007452 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dbd383f1-0b5b-4b37-8ba9-cab4724f6590 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:21.007885 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dbd383f1-0b5b-4b37-8ba9-cab4724f6590 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:21.133917 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-dbd383f1-0b5b-4b37-8ba9-cab4724f6590 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:21.141373 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-dbd383f1-0b5b-4b37-8ba9-cab4724f6590 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1266 microversion: 2.1 time: 0.145978 Apr 12 00:34:21.141942 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 440/904] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:20 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:22.158084 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-49a5d247-d045-4c3c-89ac-e31d4a5b827d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:22.159137 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-49a5d247-d045-4c3c-89ac-e31d4a5b827d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:22.165706 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-49a5d247-d045-4c3c-89ac-e31d4a5b827d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:22.166154 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-49a5d247-d045-4c3c-89ac-e31d4a5b827d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:22.166950 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-49a5d247-d045-4c3c-89ac-e31d4a5b827d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:22.167384 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-49a5d247-d045-4c3c-89ac-e31d4a5b827d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:22.296676 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-49a5d247-d045-4c3c-89ac-e31d4a5b827d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:22.304153 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-49a5d247-d045-4c3c-89ac-e31d4a5b827d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1266 microversion: 2.1 time: 0.150914 Apr 12 00:34:22.304715 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 465/905] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:22 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:22.729496 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a0f4b03a-72de-4a57-9554-aa7c39fdbd80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:22.730042 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a0f4b03a-72de-4a57-9554-aa7c39fdbd80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:22.737073 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a0f4b03a-72de-4a57-9554-aa7c39fdbd80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:22.737512 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a0f4b03a-72de-4a57-9554-aa7c39fdbd80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:22.738282 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a0f4b03a-72de-4a57-9554-aa7c39fdbd80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:22.738721 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a0f4b03a-72de-4a57-9554-aa7c39fdbd80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:22.759445 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-a0f4b03a-72de-4a57-9554-aa7c39fdbd80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lazy-loading 'flavor' on Instance uuid 6fd000ee-5205-4d02-b7a8-8c99871c8f29 {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:34:23.013098 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a0f4b03a-72de-4a57-9554-aa7c39fdbd80 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "POST /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29/action" status: 202 len: 0 microversion: 2.20 time: 0.287270 Apr 12 00:34:23.014464 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 441/906] 10.222.0.32 () {62 vars in 1318 bytes} [Tue Apr 12 00:34:22 2022] POST /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:34:23.023398 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3c2ec01a-bd21-4ca5-bde1-ecd18c8afb9b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:23.024372 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3c2ec01a-bd21-4ca5-bde1-ecd18c8afb9b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:23.031201 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3c2ec01a-bd21-4ca5-bde1-ecd18c8afb9b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:23.031997 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3c2ec01a-bd21-4ca5-bde1-ecd18c8afb9b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:23.033391 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3c2ec01a-bd21-4ca5-bde1-ecd18c8afb9b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:23.033982 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3c2ec01a-bd21-4ca5-bde1-ecd18c8afb9b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:23.147024 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-cc585e58-c591-4bc9-bdbe-afbc67ee37fa req-41ac689b-cc9c-4670-8f34-ec6d60c7e267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a3357fa-5beb-40ae-ba19-95e893acd4b8", "name": "network-vif-plugged", "status": "completed", "tag": "eacce356-7ace-426f-a907-2db9bedc490d"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:23.155425 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-cc585e58-c591-4bc9-bdbe-afbc67ee37fa req-41ac689b-cc9c-4670-8f34-ec6d60c7e267 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:23.155871 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-cc585e58-c591-4bc9-bdbe-afbc67ee37fa req-41ac689b-cc9c-4670-8f34-ec6d60c7e267 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:23.168453 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-cc585e58-c591-4bc9-bdbe-afbc67ee37fa req-41ac689b-cc9c-4670-8f34-ec6d60c7e267 service nova] Creating event network-vif-plugged:eacce356-7ace-426f-a907-2db9bedc490d for instance 4a3357fa-5beb-40ae-ba19-95e893acd4b8 on hv-cinder-83625 Apr 12 00:34:23.173955 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-cc585e58-c591-4bc9-bdbe-afbc67ee37fa req-41ac689b-cc9c-4670-8f34-ec6d60c7e267 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030676 Apr 12 00:34:23.174581 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3c2ec01a-bd21-4ca5-bde1-ecd18c8afb9b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:23.175625 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 442/907] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:34:23.182850 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3c2ec01a-bd21-4ca5-bde1-ecd18c8afb9b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:23.184341 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3c2ec01a-bd21-4ca5-bde1-ecd18c8afb9b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:23.185508 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3c2ec01a-bd21-4ca5-bde1-ecd18c8afb9b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.166772 Apr 12 00:34:23.186052 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 466/908] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:23 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:34:23.321576 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-43038077-d985-48c6-9209-0a685f395657 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:23.322282 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-43038077-d985-48c6-9209-0a685f395657 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:23.328338 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-43038077-d985-48c6-9209-0a685f395657 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:23.328780 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-43038077-d985-48c6-9209-0a685f395657 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:23.329562 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-43038077-d985-48c6-9209-0a685f395657 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:23.329994 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-43038077-d985-48c6-9209-0a685f395657 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:23.493428 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-43038077-d985-48c6-9209-0a685f395657 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:23.500955 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-43038077-d985-48c6-9209-0a685f395657 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1266 microversion: 2.1 time: 0.183533 Apr 12 00:34:23.501534 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 443/909] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:23 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:24.205022 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4162252e-10be-4c00-b393-1968227da203 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:24.205736 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4162252e-10be-4c00-b393-1968227da203 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:24.212032 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4162252e-10be-4c00-b393-1968227da203 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:24.212471 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4162252e-10be-4c00-b393-1968227da203 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:24.213236 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4162252e-10be-4c00-b393-1968227da203 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:24.213670 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4162252e-10be-4c00-b393-1968227da203 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:24.348885 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4162252e-10be-4c00-b393-1968227da203 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:24.357263 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4162252e-10be-4c00-b393-1968227da203 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:24.359046 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4162252e-10be-4c00-b393-1968227da203 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:24.360392 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4162252e-10be-4c00-b393-1968227da203 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.159261 Apr 12 00:34:24.361826 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 467/910] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:24 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:24.517490 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-63a7e9c2-4d18-4d22-86ef-9475862ca638 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:24.518135 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-63a7e9c2-4d18-4d22-86ef-9475862ca638 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:24.524509 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-63a7e9c2-4d18-4d22-86ef-9475862ca638 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:24.524947 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-63a7e9c2-4d18-4d22-86ef-9475862ca638 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:24.525708 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-63a7e9c2-4d18-4d22-86ef-9475862ca638 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:24.526145 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-63a7e9c2-4d18-4d22-86ef-9475862ca638 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:24.652328 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-63a7e9c2-4d18-4d22-86ef-9475862ca638 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:24.660344 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-63a7e9c2-4d18-4d22-86ef-9475862ca638 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1266 microversion: 2.1 time: 0.146957 Apr 12 00:34:24.660919 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 444/911] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:24 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:25.380304 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a8f05de3-b8c0-413c-8bcc-b6ac7013bb09 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:25.380918 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a8f05de3-b8c0-413c-8bcc-b6ac7013bb09 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:25.387236 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8f05de3-b8c0-413c-8bcc-b6ac7013bb09 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:25.387691 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8f05de3-b8c0-413c-8bcc-b6ac7013bb09 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:25.388460 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8f05de3-b8c0-413c-8bcc-b6ac7013bb09 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:25.388917 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a8f05de3-b8c0-413c-8bcc-b6ac7013bb09 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:25.523956 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a8f05de3-b8c0-413c-8bcc-b6ac7013bb09 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:25.531992 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a8f05de3-b8c0-413c-8bcc-b6ac7013bb09 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:25.533714 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a8f05de3-b8c0-413c-8bcc-b6ac7013bb09 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:25.534921 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a8f05de3-b8c0-413c-8bcc-b6ac7013bb09 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.159387 Apr 12 00:34:25.535485 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 468/912] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:25 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:25.677401 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c71fa5c0-f8e8-4e04-887b-e2c3dbbaea48 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:25.678013 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c71fa5c0-f8e8-4e04-887b-e2c3dbbaea48 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:25.684449 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c71fa5c0-f8e8-4e04-887b-e2c3dbbaea48 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:25.684897 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c71fa5c0-f8e8-4e04-887b-e2c3dbbaea48 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:25.685665 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c71fa5c0-f8e8-4e04-887b-e2c3dbbaea48 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:25.686114 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c71fa5c0-f8e8-4e04-887b-e2c3dbbaea48 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:25.816100 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c71fa5c0-f8e8-4e04-887b-e2c3dbbaea48 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:25.823345 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c71fa5c0-f8e8-4e04-887b-e2c3dbbaea48 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1452 microversion: 2.1 time: 0.150394 Apr 12 00:34:25.823915 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 445/913] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:25 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:25.839639 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2fd817a5-63fc-4e08-bb43-b0e37655093a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:25.840255 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-2fd817a5-63fc-4e08-bb43-b0e37655093a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:25.846066 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2fd817a5-63fc-4e08-bb43-b0e37655093a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:25.846556 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2fd817a5-63fc-4e08-bb43-b0e37655093a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:25.847319 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2fd817a5-63fc-4e08-bb43-b0e37655093a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:25.847757 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2fd817a5-63fc-4e08-bb43-b0e37655093a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:25.969880 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2fd817a5-63fc-4e08-bb43-b0e37655093a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:25.977624 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2fd817a5-63fc-4e08-bb43-b0e37655093a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1452 microversion: 2.1 time: 0.141817 Apr 12 00:34:25.978192 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 469/914] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:25 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1452 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:26.553160 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1a5ec7ba-f19f-4e70-962a-3df5cbc3a297 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:26.553682 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1a5ec7ba-f19f-4e70-962a-3df5cbc3a297 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:26.559520 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1a5ec7ba-f19f-4e70-962a-3df5cbc3a297 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:26.559965 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1a5ec7ba-f19f-4e70-962a-3df5cbc3a297 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:26.560755 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1a5ec7ba-f19f-4e70-962a-3df5cbc3a297 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:26.561190 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1a5ec7ba-f19f-4e70-962a-3df5cbc3a297 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:26.694162 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1a5ec7ba-f19f-4e70-962a-3df5cbc3a297 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:26.702104 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1a5ec7ba-f19f-4e70-962a-3df5cbc3a297 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:26.703792 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-1a5ec7ba-f19f-4e70-962a-3df5cbc3a297 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:26.705632 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1a5ec7ba-f19f-4e70-962a-3df5cbc3a297 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.156488 Apr 12 00:34:26.706296 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 446/915] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:26 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:27.724039 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-47f19b26-b8b8-483f-a185-4be6a1c3e8ea tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:27.724666 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-47f19b26-b8b8-483f-a185-4be6a1c3e8ea tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:27.733165 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-a41a9dbc-4c06-436d-9bdb-7c35e88b7aae req-9010fcfc-cd6b-4ac3-8965-5b4725d30e73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a3357fa-5beb-40ae-ba19-95e893acd4b8", "tag": "eacce356-7ace-426f-a907-2db9bedc490d"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:27.740525 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-47f19b26-b8b8-483f-a185-4be6a1c3e8ea tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:27.740982 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-47f19b26-b8b8-483f-a185-4be6a1c3e8ea tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:27.741760 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-47f19b26-b8b8-483f-a185-4be6a1c3e8ea tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:27.742202 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-47f19b26-b8b8-483f-a185-4be6a1c3e8ea tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:27.750016 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-a41a9dbc-4c06-436d-9bdb-7c35e88b7aae req-9010fcfc-cd6b-4ac3-8965-5b4725d30e73 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:27.750388 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-a41a9dbc-4c06-436d-9bdb-7c35e88b7aae req-9010fcfc-cd6b-4ac3-8965-5b4725d30e73 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:27.762048 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-a41a9dbc-4c06-436d-9bdb-7c35e88b7aae req-9010fcfc-cd6b-4ac3-8965-5b4725d30e73 service nova] Creating event network-changed:eacce356-7ace-426f-a907-2db9bedc490d for instance 4a3357fa-5beb-40ae-ba19-95e893acd4b8 on hv-cinder-83625 Apr 12 00:34:27.767508 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-a41a9dbc-4c06-436d-9bdb-7c35e88b7aae req-9010fcfc-cd6b-4ac3-8965-5b4725d30e73 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038148 Apr 12 00:34:27.768378 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 447/916] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:34:27.867890 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-47f19b26-b8b8-483f-a185-4be6a1c3e8ea tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:27.875724 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-47f19b26-b8b8-483f-a185-4be6a1c3e8ea tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:27.877236 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-47f19b26-b8b8-483f-a185-4be6a1c3e8ea tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:27.878428 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-47f19b26-b8b8-483f-a185-4be6a1c3e8ea tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.158493 Apr 12 00:34:27.878995 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 470/917] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:27 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:28.898062 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-6a0c1835-c457-46df-9f32-b7df3ea7f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:28.898788 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-6a0c1835-c457-46df-9f32-b7df3ea7f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:28.904896 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6a0c1835-c457-46df-9f32-b7df3ea7f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:28.905347 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6a0c1835-c457-46df-9f32-b7df3ea7f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:28.906134 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6a0c1835-c457-46df-9f32-b7df3ea7f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:28.906593 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6a0c1835-c457-46df-9f32-b7df3ea7f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:29.036439 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-6a0c1835-c457-46df-9f32-b7df3ea7f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:29.044140 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-6a0c1835-c457-46df-9f32-b7df3ea7f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:29.045632 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-6a0c1835-c457-46df-9f32-b7df3ea7f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:29.046814 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-6a0c1835-c457-46df-9f32-b7df3ea7f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.153527 Apr 12 00:34:29.047374 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 448/918] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:28 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:30.065930 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2ba17b6b-94c2-49c1-ade3-7111b80b6af1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:30.066506 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-2ba17b6b-94c2-49c1-ade3-7111b80b6af1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:30.072708 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2ba17b6b-94c2-49c1-ade3-7111b80b6af1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:30.073163 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2ba17b6b-94c2-49c1-ade3-7111b80b6af1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:30.073931 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2ba17b6b-94c2-49c1-ade3-7111b80b6af1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:30.074404 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2ba17b6b-94c2-49c1-ade3-7111b80b6af1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:30.199547 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2ba17b6b-94c2-49c1-ade3-7111b80b6af1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:30.208326 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2ba17b6b-94c2-49c1-ade3-7111b80b6af1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:30.209896 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2ba17b6b-94c2-49c1-ade3-7111b80b6af1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:30.211148 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2ba17b6b-94c2-49c1-ade3-7111b80b6af1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.149810 Apr 12 00:34:30.211746 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 471/919] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:30 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:31.230944 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2ba7fe41-b9a6-4cf0-ba66-d4cfe26d64a9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:31.231487 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2ba7fe41-b9a6-4cf0-ba66-d4cfe26d64a9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:31.238476 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2ba7fe41-b9a6-4cf0-ba66-d4cfe26d64a9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:31.239004 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2ba7fe41-b9a6-4cf0-ba66-d4cfe26d64a9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:31.239793 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2ba7fe41-b9a6-4cf0-ba66-d4cfe26d64a9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:31.240230 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2ba7fe41-b9a6-4cf0-ba66-d4cfe26d64a9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:31.367481 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2ba7fe41-b9a6-4cf0-ba66-d4cfe26d64a9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:31.375262 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2ba7fe41-b9a6-4cf0-ba66-d4cfe26d64a9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:31.376928 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2ba7fe41-b9a6-4cf0-ba66-d4cfe26d64a9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:31.378099 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2ba7fe41-b9a6-4cf0-ba66-d4cfe26d64a9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.151145 Apr 12 00:34:31.378699 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 449/920] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:31 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:32.396826 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-fb49bf39-745a-4d2d-b173-387c9f6fda7f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:32.397352 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-fb49bf39-745a-4d2d-b173-387c9f6fda7f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:32.403676 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fb49bf39-745a-4d2d-b173-387c9f6fda7f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:32.404133 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fb49bf39-745a-4d2d-b173-387c9f6fda7f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:32.404939 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fb49bf39-745a-4d2d-b173-387c9f6fda7f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:32.405380 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fb49bf39-745a-4d2d-b173-387c9f6fda7f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:32.531055 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-fb49bf39-745a-4d2d-b173-387c9f6fda7f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:32.539768 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-fb49bf39-745a-4d2d-b173-387c9f6fda7f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:32.541265 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-fb49bf39-745a-4d2d-b173-387c9f6fda7f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:32.542447 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-fb49bf39-745a-4d2d-b173-387c9f6fda7f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.149588 Apr 12 00:34:32.543007 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 472/921] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:32 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:33.561703 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-fdf217ab-d03b-4662-9aef-f14acc4a4ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:33.562242 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-fdf217ab-d03b-4662-9aef-f14acc4a4ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:33.569034 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fdf217ab-d03b-4662-9aef-f14acc4a4ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:33.569482 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fdf217ab-d03b-4662-9aef-f14acc4a4ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:33.570318 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fdf217ab-d03b-4662-9aef-f14acc4a4ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:33.570750 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fdf217ab-d03b-4662-9aef-f14acc4a4ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:33.726624 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-fdf217ab-d03b-4662-9aef-f14acc4a4ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:33.734568 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-fdf217ab-d03b-4662-9aef-f14acc4a4ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:33.736720 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-fdf217ab-d03b-4662-9aef-f14acc4a4ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:33.737911 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-fdf217ab-d03b-4662-9aef-f14acc4a4ef4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.180165 Apr 12 00:34:33.738547 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 450/922] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:33 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:34.755996 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-55639b69-9ea4-43de-9025-c3dd8d68ff29 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:34.756627 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-55639b69-9ea4-43de-9025-c3dd8d68ff29 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:34.763311 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-55639b69-9ea4-43de-9025-c3dd8d68ff29 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:34.763997 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-55639b69-9ea4-43de-9025-c3dd8d68ff29 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:34.764525 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-55639b69-9ea4-43de-9025-c3dd8d68ff29 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:34.764966 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-55639b69-9ea4-43de-9025-c3dd8d68ff29 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:34.920872 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-55639b69-9ea4-43de-9025-c3dd8d68ff29 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:34.929122 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-55639b69-9ea4-43de-9025-c3dd8d68ff29 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:34.931022 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-55639b69-9ea4-43de-9025-c3dd8d68ff29 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:34.932433 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-55639b69-9ea4-43de-9025-c3dd8d68ff29 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.180163 Apr 12 00:34:34.933235 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 473/923] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:34 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:35.950329 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-44212d13-e375-44d5-8db3-b4a1b68a50a8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:35.950964 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-44212d13-e375-44d5-8db3-b4a1b68a50a8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:35.957974 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-44212d13-e375-44d5-8db3-b4a1b68a50a8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:35.958467 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-44212d13-e375-44d5-8db3-b4a1b68a50a8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:35.959223 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-44212d13-e375-44d5-8db3-b4a1b68a50a8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:35.959660 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-44212d13-e375-44d5-8db3-b4a1b68a50a8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:36.094456 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-44212d13-e375-44d5-8db3-b4a1b68a50a8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:36.104384 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-44212d13-e375-44d5-8db3-b4a1b68a50a8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:36.105892 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-44212d13-e375-44d5-8db3-b4a1b68a50a8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:36.107124 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-44212d13-e375-44d5-8db3-b4a1b68a50a8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.160797 Apr 12 00:34:36.107687 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 451/924] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:35 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:37.125055 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3bdfa60f-b839-400b-bf29-c7e4ccc989b4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:37.125730 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3bdfa60f-b839-400b-bf29-c7e4ccc989b4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:37.131908 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3bdfa60f-b839-400b-bf29-c7e4ccc989b4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:37.132356 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3bdfa60f-b839-400b-bf29-c7e4ccc989b4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:37.133125 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3bdfa60f-b839-400b-bf29-c7e4ccc989b4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:37.133558 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3bdfa60f-b839-400b-bf29-c7e4ccc989b4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:37.265353 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3bdfa60f-b839-400b-bf29-c7e4ccc989b4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:37.273790 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3bdfa60f-b839-400b-bf29-c7e4ccc989b4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:37.275582 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3bdfa60f-b839-400b-bf29-c7e4ccc989b4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:37.276746 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3bdfa60f-b839-400b-bf29-c7e4ccc989b4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.155557 Apr 12 00:34:37.277341 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 474/925] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:37 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:38.295693 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-be0127c3-5b19-4471-9536-e4c9ef52b2c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:38.296302 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-be0127c3-5b19-4471-9536-e4c9ef52b2c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:38.302187 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-be0127c3-5b19-4471-9536-e4c9ef52b2c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:38.302667 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-be0127c3-5b19-4471-9536-e4c9ef52b2c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:38.303427 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-be0127c3-5b19-4471-9536-e4c9ef52b2c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:38.303884 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-be0127c3-5b19-4471-9536-e4c9ef52b2c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:38.434123 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-be0127c3-5b19-4471-9536-e4c9ef52b2c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:38.443521 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-be0127c3-5b19-4471-9536-e4c9ef52b2c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:38.445030 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-be0127c3-5b19-4471-9536-e4c9ef52b2c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:38.446189 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-be0127c3-5b19-4471-9536-e4c9ef52b2c2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.154615 Apr 12 00:34:38.446779 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 452/926] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:38 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:39.465646 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0eb6b4d8-a7a8-42ed-b1be-8e3e4fe1f4b7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:39.466414 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0eb6b4d8-a7a8-42ed-b1be-8e3e4fe1f4b7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:39.472573 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0eb6b4d8-a7a8-42ed-b1be-8e3e4fe1f4b7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:39.473129 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0eb6b4d8-a7a8-42ed-b1be-8e3e4fe1f4b7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:39.474221 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0eb6b4d8-a7a8-42ed-b1be-8e3e4fe1f4b7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:39.474758 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0eb6b4d8-a7a8-42ed-b1be-8e3e4fe1f4b7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:39.606614 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0eb6b4d8-a7a8-42ed-b1be-8e3e4fe1f4b7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:39.614812 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0eb6b4d8-a7a8-42ed-b1be-8e3e4fe1f4b7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:39.616309 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0eb6b4d8-a7a8-42ed-b1be-8e3e4fe1f4b7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:39.617462 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0eb6b4d8-a7a8-42ed-b1be-8e3e4fe1f4b7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.156291 Apr 12 00:34:39.618023 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 475/927] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:39 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:40.635571 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b13de74a-97bc-4443-a0a5-d57f697e130a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:40.636173 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b13de74a-97bc-4443-a0a5-d57f697e130a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:40.643183 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b13de74a-97bc-4443-a0a5-d57f697e130a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:40.643627 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b13de74a-97bc-4443-a0a5-d57f697e130a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:40.644471 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b13de74a-97bc-4443-a0a5-d57f697e130a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:40.644908 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b13de74a-97bc-4443-a0a5-d57f697e130a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:40.771592 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b13de74a-97bc-4443-a0a5-d57f697e130a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:40.779376 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b13de74a-97bc-4443-a0a5-d57f697e130a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:40.780872 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b13de74a-97bc-4443-a0a5-d57f697e130a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:40.782019 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b13de74a-97bc-4443-a0a5-d57f697e130a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1745 microversion: 2.20 time: 0.150305 Apr 12 00:34:40.782687 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 453/928] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:40 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:41.016691 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-403abdd1-7753-4219-8f78-f2630343a6d0 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-630781843", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:41.065475 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.network.neutron [None req-403abdd1-7753-4219-8f78-f2630343a6d0 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] validate_networks() for None {{(pid=128486) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:34:41.332986 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-403abdd1-7753-4219-8f78-f2630343a6d0 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Flavor limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:34:41.333408 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-403abdd1-7753-4219-8f78-f2630343a6d0 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Image limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:34:41.333874 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-403abdd1-7753-4219-8f78-f2630343a6d0 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Flavor pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:34:41.334300 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-403abdd1-7753-4219-8f78-f2630343a6d0 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Image pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:34:41.334708 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-403abdd1-7753-4219-8f78-f2630343a6d0 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:34:41.343396 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-403abdd1-7753-4219-8f78-f2630343a6d0 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:41.343845 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-403abdd1-7753-4219-8f78-f2630343a6d0 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:41.344639 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-403abdd1-7753-4219-8f78-f2630343a6d0 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:41.345072 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-403abdd1-7753-4219-8f78-f2630343a6d0 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:41.361618 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-403abdd1-7753-4219-8f78-f2630343a6d0 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Getting quotas for project 323743848f174ae7a70cc2d0952db4e1. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:34:41.365578 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-403abdd1-7753-4219-8f78-f2630343a6d0 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Getting quotas for user 713cc5554a6b4fa2a68d66006f907f4c and project 323743848f174ae7a70cc2d0952db4e1. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:34:41.376815 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-403abdd1-7753-4219-8f78-f2630343a6d0 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Going to run 1 instances... {{(pid=128486) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:34:41.379159 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-403abdd1-7753-4219-8f78-f2630343a6d0 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:34:41.422441 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-403abdd1-7753-4219-8f78-f2630343a6d0 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.409789 Apr 12 00:34:41.423594 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 476/929] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:34:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:34:41.433831 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3f670391-2777-4e1e-abfa-70d545753ff9 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:41.434419 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3f670391-2777-4e1e-abfa-70d545753ff9 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:41.487245 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-3f670391-2777-4e1e-abfa-70d545753ff9 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713cc5554a6b4fa2a68d66006f907f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323743848f174ae7a70cc2d0952db4e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:41.493729 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3f670391-2777-4e1e-abfa-70d545753ff9 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 200 len: 1214 microversion: 2.1 time: 0.064130 Apr 12 00:34:41.494682 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 454/930] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:41 2022] GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:41.801019 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a4c0d505-cb3d-4c31-ac23-3e81e952da59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:41.801652 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a4c0d505-cb3d-4c31-ac23-3e81e952da59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:41.808117 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a4c0d505-cb3d-4c31-ac23-3e81e952da59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:41.808574 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a4c0d505-cb3d-4c31-ac23-3e81e952da59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:41.809336 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a4c0d505-cb3d-4c31-ac23-3e81e952da59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:41.809775 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a4c0d505-cb3d-4c31-ac23-3e81e952da59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:41.939077 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a4c0d505-cb3d-4c31-ac23-3e81e952da59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:41.946960 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a4c0d505-cb3d-4c31-ac23-3e81e952da59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:41.948448 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a4c0d505-cb3d-4c31-ac23-3e81e952da59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:41.949590 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a4c0d505-cb3d-4c31-ac23-3e81e952da59 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1745 microversion: 2.20 time: 0.152754 Apr 12 00:34:41.950147 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 477/931] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:41 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:42.510057 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-145dced7-59cc-4858-ac23-9ef836104416 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:42.510699 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-145dced7-59cc-4858-ac23-9ef836104416 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:42.518344 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-145dced7-59cc-4858-ac23-9ef836104416 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:42.518787 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-145dced7-59cc-4858-ac23-9ef836104416 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:42.519544 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-145dced7-59cc-4858-ac23-9ef836104416 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:42.519969 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-145dced7-59cc-4858-ac23-9ef836104416 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:42.578309 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-145dced7-59cc-4858-ac23-9ef836104416 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713cc5554a6b4fa2a68d66006f907f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323743848f174ae7a70cc2d0952db4e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:42.586522 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-145dced7-59cc-4858-ac23-9ef836104416 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 200 len: 1266 microversion: 2.1 time: 0.080263 Apr 12 00:34:42.587077 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 455/932] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:42 2022] GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:42.967726 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8bb337e7-5306-4e01-9d38-489834a3370c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:42.968369 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8bb337e7-5306-4e01-9d38-489834a3370c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:42.974778 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8bb337e7-5306-4e01-9d38-489834a3370c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:42.975220 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8bb337e7-5306-4e01-9d38-489834a3370c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:42.975982 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8bb337e7-5306-4e01-9d38-489834a3370c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:42.976412 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8bb337e7-5306-4e01-9d38-489834a3370c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:43.102573 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8bb337e7-5306-4e01-9d38-489834a3370c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:43.112594 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8bb337e7-5306-4e01-9d38-489834a3370c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:43.115184 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8bb337e7-5306-4e01-9d38-489834a3370c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:43.117231 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8bb337e7-5306-4e01-9d38-489834a3370c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1745 microversion: 2.20 time: 0.153588 Apr 12 00:34:43.117880 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 478/933] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:42 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:34:43.602605 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-0dfc938e-41ff-46ae-bc5f-1eaadf9bf495 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:43.603906 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-0dfc938e-41ff-46ae-bc5f-1eaadf9bf495 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:43.611373 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0dfc938e-41ff-46ae-bc5f-1eaadf9bf495 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:43.612142 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0dfc938e-41ff-46ae-bc5f-1eaadf9bf495 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:43.612964 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0dfc938e-41ff-46ae-bc5f-1eaadf9bf495 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:43.613397 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0dfc938e-41ff-46ae-bc5f-1eaadf9bf495 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:43.838729 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-0dfc938e-41ff-46ae-bc5f-1eaadf9bf495 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713cc5554a6b4fa2a68d66006f907f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323743848f174ae7a70cc2d0952db4e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:43.855100 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-0dfc938e-41ff-46ae-bc5f-1eaadf9bf495 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 200 len: 1314 microversion: 2.1 time: 0.256402 Apr 12 00:34:43.855878 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 456/934] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:43 2022] GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:44.134990 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b4239373-a117-4288-85ae-e24fd665fea6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:44.135609 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b4239373-a117-4288-85ae-e24fd665fea6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:44.143766 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b4239373-a117-4288-85ae-e24fd665fea6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:44.144228 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b4239373-a117-4288-85ae-e24fd665fea6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:44.145067 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b4239373-a117-4288-85ae-e24fd665fea6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:44.145654 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b4239373-a117-4288-85ae-e24fd665fea6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:44.195486 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-1320670d-e1de-42b5-8fed-cbef2be6789c req-f7bca69c-acb0-481a-bf09-034203c1dd7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb7e0f60-c90d-4cbc-aebb-e437add4adbf", "tag": "9fb05f00-cf2d-4b1f-936a-505b6cfc34bb"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:44.205052 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-1320670d-e1de-42b5-8fed-cbef2be6789c req-f7bca69c-acb0-481a-bf09-034203c1dd7f service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:44.208998 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-1320670d-e1de-42b5-8fed-cbef2be6789c req-f7bca69c-acb0-481a-bf09-034203c1dd7f service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:44.230578 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-1320670d-e1de-42b5-8fed-cbef2be6789c req-f7bca69c-acb0-481a-bf09-034203c1dd7f service nova] Creating event network-changed:9fb05f00-cf2d-4b1f-936a-505b6cfc34bb for instance cb7e0f60-c90d-4cbc-aebb-e437add4adbf on hv-cinder-83625 Apr 12 00:34:44.238669 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-1320670d-e1de-42b5-8fed-cbef2be6789c req-f7bca69c-acb0-481a-bf09-034203c1dd7f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049104 Apr 12 00:34:44.239796 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 457/935] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:44.293122 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b4239373-a117-4288-85ae-e24fd665fea6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:44.301921 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b4239373-a117-4288-85ae-e24fd665fea6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:44.303589 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b4239373-a117-4288-85ae-e24fd665fea6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:44.304762 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b4239373-a117-4288-85ae-e24fd665fea6 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1745 microversion: 2.20 time: 0.173742 Apr 12 00:34:44.305330 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 479/936] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:44 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:44.873492 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-10304454-d6ca-4891-b0d2-69f76c594a42 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:44.874191 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-10304454-d6ca-4891-b0d2-69f76c594a42 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:44.880708 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-10304454-d6ca-4891-b0d2-69f76c594a42 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:44.881154 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-10304454-d6ca-4891-b0d2-69f76c594a42 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:44.881910 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-10304454-d6ca-4891-b0d2-69f76c594a42 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:44.882371 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-10304454-d6ca-4891-b0d2-69f76c594a42 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:45.249714 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-8b233978-7238-4604-824b-8e7e3175800e req-d745ef87-93f6-4f0e-ac3e-bf19d52d355a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd000ee-5205-4d02-b7a8-8c99871c8f29", "name": "network-vif-plugged", "status": "completed", "tag": "0e9155b9-7112-41cd-b8ec-dd359b342b3a"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:45.259567 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-8b233978-7238-4604-824b-8e7e3175800e req-d745ef87-93f6-4f0e-ac3e-bf19d52d355a service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:45.260093 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-8b233978-7238-4604-824b-8e7e3175800e req-d745ef87-93f6-4f0e-ac3e-bf19d52d355a service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:45.272851 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-8b233978-7238-4604-824b-8e7e3175800e req-d745ef87-93f6-4f0e-ac3e-bf19d52d355a service nova] Creating event network-vif-plugged:0e9155b9-7112-41cd-b8ec-dd359b342b3a for instance 6fd000ee-5205-4d02-b7a8-8c99871c8f29 on hv-cinder-83625 Apr 12 00:34:45.278136 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-8b233978-7238-4604-824b-8e7e3175800e req-d745ef87-93f6-4f0e-ac3e-bf19d52d355a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032163 Apr 12 00:34:45.278846 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 480/937] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:34:45.323373 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2a6cf046-f2a8-4b45-a5ed-e26753a1f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:45.324164 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-2a6cf046-f2a8-4b45-a5ed-e26753a1f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:45.330511 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2a6cf046-f2a8-4b45-a5ed-e26753a1f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:45.330970 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2a6cf046-f2a8-4b45-a5ed-e26753a1f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:45.331744 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2a6cf046-f2a8-4b45-a5ed-e26753a1f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:45.332183 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2a6cf046-f2a8-4b45-a5ed-e26753a1f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:45.352030 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-10304454-d6ca-4891-b0d2-69f76c594a42 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713cc5554a6b4fa2a68d66006f907f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323743848f174ae7a70cc2d0952db4e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:45.359739 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-10304454-d6ca-4891-b0d2-69f76c594a42 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 200 len: 1314 microversion: 2.1 time: 0.490786 Apr 12 00:34:45.360572 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 458/938] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:44 2022] GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:45.461604 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2a6cf046-f2a8-4b45-a5ed-e26753a1f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:45.469779 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2a6cf046-f2a8-4b45-a5ed-e26753a1f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:45.471377 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2a6cf046-f2a8-4b45-a5ed-e26753a1f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:45.472579 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2a6cf046-f2a8-4b45-a5ed-e26753a1f750 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1745 microversion: 2.20 time: 0.153661 Apr 12 00:34:45.473142 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 481/939] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:45 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:34:46.377552 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9afc79cb-9e9b-443d-a82e-648e5327c221 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:46.378157 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-9afc79cb-9e9b-443d-a82e-648e5327c221 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:46.384444 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9afc79cb-9e9b-443d-a82e-648e5327c221 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:46.384883 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9afc79cb-9e9b-443d-a82e-648e5327c221 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:46.385634 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9afc79cb-9e9b-443d-a82e-648e5327c221 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:46.386228 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9afc79cb-9e9b-443d-a82e-648e5327c221 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:46.491412 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-728eaffb-7a2c-4055-9711-3973c9fa77cb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:46.492133 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-728eaffb-7a2c-4055-9711-3973c9fa77cb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:46.498531 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-728eaffb-7a2c-4055-9711-3973c9fa77cb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:46.499057 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-728eaffb-7a2c-4055-9711-3973c9fa77cb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:46.499920 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-728eaffb-7a2c-4055-9711-3973c9fa77cb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:46.500365 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-728eaffb-7a2c-4055-9711-3973c9fa77cb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:46.514229 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9afc79cb-9e9b-443d-a82e-648e5327c221 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713cc5554a6b4fa2a68d66006f907f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323743848f174ae7a70cc2d0952db4e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:46.521671 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9afc79cb-9e9b-443d-a82e-648e5327c221 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 200 len: 1314 microversion: 2.1 time: 0.148712 Apr 12 00:34:46.522237 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 459/940] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:46 2022] GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:46.625158 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-728eaffb-7a2c-4055-9711-3973c9fa77cb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:46.632846 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-728eaffb-7a2c-4055-9711-3973c9fa77cb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:46.634427 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-728eaffb-7a2c-4055-9711-3973c9fa77cb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:46.635579 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-728eaffb-7a2c-4055-9711-3973c9fa77cb tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1745 microversion: 2.20 time: 0.148162 Apr 12 00:34:46.636142 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 482/941] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:46 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1745 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:34:47.537462 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2f0a5854-65dc-4edd-ae9e-0c9078c4017d tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:47.538067 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2f0a5854-65dc-4edd-ae9e-0c9078c4017d tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:47.544322 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2f0a5854-65dc-4edd-ae9e-0c9078c4017d tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:47.544762 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2f0a5854-65dc-4edd-ae9e-0c9078c4017d tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:47.545514 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2f0a5854-65dc-4edd-ae9e-0c9078c4017d tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:47.545942 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2f0a5854-65dc-4edd-ae9e-0c9078c4017d tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:47.654852 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-559efc86-e2a2-4fe4-8976-adb1401924ec tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:47.656071 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-559efc86-e2a2-4fe4-8976-adb1401924ec tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:47.662345 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-559efc86-e2a2-4fe4-8976-adb1401924ec tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:47.662797 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-559efc86-e2a2-4fe4-8976-adb1401924ec tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:47.663565 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-559efc86-e2a2-4fe4-8976-adb1401924ec tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:47.664173 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-559efc86-e2a2-4fe4-8976-adb1401924ec tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:47.673579 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2f0a5854-65dc-4edd-ae9e-0c9078c4017d tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713cc5554a6b4fa2a68d66006f907f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323743848f174ae7a70cc2d0952db4e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:47.680864 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2f0a5854-65dc-4edd-ae9e-0c9078c4017d tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 200 len: 1314 microversion: 2.1 time: 0.147181 Apr 12 00:34:47.681442 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 460/942] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:47 2022] GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:47.790722 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-559efc86-e2a2-4fe4-8976-adb1401924ec tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:47.798553 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-559efc86-e2a2-4fe4-8976-adb1401924ec tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:47.800070 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-559efc86-e2a2-4fe4-8976-adb1401924ec tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:47.801225 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-559efc86-e2a2-4fe4-8976-adb1401924ec tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1745 microversion: 2.20 time: 0.150339 Apr 12 00:34:47.801799 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 483/943] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:47 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:48.698600 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a9de379f-b4df-478e-a218-803a04a11101 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:48.699279 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a9de379f-b4df-478e-a218-803a04a11101 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:48.705953 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a9de379f-b4df-478e-a218-803a04a11101 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:48.706451 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a9de379f-b4df-478e-a218-803a04a11101 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:48.707252 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a9de379f-b4df-478e-a218-803a04a11101 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:48.707709 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a9de379f-b4df-478e-a218-803a04a11101 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:48.824254 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-566210eb-9f26-41cf-8446-db2088fa921a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:48.827408 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-566210eb-9f26-41cf-8446-db2088fa921a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:48.840730 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-566210eb-9f26-41cf-8446-db2088fa921a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:48.842781 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-566210eb-9f26-41cf-8446-db2088fa921a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:48.844548 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-566210eb-9f26-41cf-8446-db2088fa921a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:48.845282 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-566210eb-9f26-41cf-8446-db2088fa921a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:48.873640 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a9de379f-b4df-478e-a218-803a04a11101 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713cc5554a6b4fa2a68d66006f907f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323743848f174ae7a70cc2d0952db4e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:48.882605 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a9de379f-b4df-478e-a218-803a04a11101 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 200 len: 1314 microversion: 2.1 time: 0.188051 Apr 12 00:34:48.894758 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 461/944] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:48 2022] GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:49.014384 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-566210eb-9f26-41cf-8446-db2088fa921a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:49.025430 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-566210eb-9f26-41cf-8446-db2088fa921a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:49.029899 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-566210eb-9f26-41cf-8446-db2088fa921a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:49.034504 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-566210eb-9f26-41cf-8446-db2088fa921a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1740 microversion: 2.20 time: 0.218964 Apr 12 00:34:49.035081 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 484/945] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:48 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:34:49.904352 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f9c5ff8d-e4cc-4911-98be-b426a9f49387 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:49.905697 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f9c5ff8d-e4cc-4911-98be-b426a9f49387 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:49.914983 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f9c5ff8d-e4cc-4911-98be-b426a9f49387 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:49.916161 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f9c5ff8d-e4cc-4911-98be-b426a9f49387 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:49.917167 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f9c5ff8d-e4cc-4911-98be-b426a9f49387 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:49.918463 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f9c5ff8d-e4cc-4911-98be-b426a9f49387 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:50.053616 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-02dfd68e-69c7-44dd-9c27-d1787a697ef8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:50.054997 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-02dfd68e-69c7-44dd-9c27-d1787a697ef8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:50.061555 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f9c5ff8d-e4cc-4911-98be-b426a9f49387 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713cc5554a6b4fa2a68d66006f907f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323743848f174ae7a70cc2d0952db4e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:50.062911 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-02dfd68e-69c7-44dd-9c27-d1787a697ef8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:50.064181 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-02dfd68e-69c7-44dd-9c27-d1787a697ef8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:50.065079 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-02dfd68e-69c7-44dd-9c27-d1787a697ef8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:50.065597 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-02dfd68e-69c7-44dd-9c27-d1787a697ef8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:50.069180 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f9c5ff8d-e4cc-4911-98be-b426a9f49387 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 200 len: 1314 microversion: 2.1 time: 0.169438 Apr 12 00:34:50.069758 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 462/946] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:49 2022] GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:50.214362 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-02dfd68e-69c7-44dd-9c27-d1787a697ef8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:50.223861 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-02dfd68e-69c7-44dd-9c27-d1787a697ef8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:50.225432 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-02dfd68e-69c7-44dd-9c27-d1787a697ef8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:50.226722 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-02dfd68e-69c7-44dd-9c27-d1787a697ef8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1740 microversion: 2.20 time: 0.176877 Apr 12 00:34:50.227292 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 485/947] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:50 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:51.086930 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-8ef7d706-0c80-48a3-a3ea-2e91718fe58e tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:51.086930 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-8ef7d706-0c80-48a3-a3ea-2e91718fe58e tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:51.093248 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8ef7d706-0c80-48a3-a3ea-2e91718fe58e tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:51.093703 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8ef7d706-0c80-48a3-a3ea-2e91718fe58e tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:51.094509 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8ef7d706-0c80-48a3-a3ea-2e91718fe58e tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:51.095512 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8ef7d706-0c80-48a3-a3ea-2e91718fe58e tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:51.245580 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9cde7e2e-26a5-49cc-a66c-0af7b2016452 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:51.246941 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9cde7e2e-26a5-49cc-a66c-0af7b2016452 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:51.254040 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9cde7e2e-26a5-49cc-a66c-0af7b2016452 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:51.255007 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9cde7e2e-26a5-49cc-a66c-0af7b2016452 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:51.256013 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9cde7e2e-26a5-49cc-a66c-0af7b2016452 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:51.256733 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9cde7e2e-26a5-49cc-a66c-0af7b2016452 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:51.267417 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-8ef7d706-0c80-48a3-a3ea-2e91718fe58e tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713cc5554a6b4fa2a68d66006f907f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323743848f174ae7a70cc2d0952db4e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:51.276949 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-8ef7d706-0c80-48a3-a3ea-2e91718fe58e tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 200 len: 1314 microversion: 2.1 time: 0.194486 Apr 12 00:34:51.278143 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 463/948] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:51 2022] GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:51.363594 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-f2755d49-a1c1-4f74-a323-45298441d7b7 req-540e5a5a-5e44-47f0-92ff-103d0097b3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7e0f60-c90d-4cbc-aebb-e437add4adbf", "name": "network-vif-plugged", "status": "completed", "tag": "9fb05f00-cf2d-4b1f-936a-505b6cfc34bb"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:51.385188 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-f2755d49-a1c1-4f74-a323-45298441d7b7 req-540e5a5a-5e44-47f0-92ff-103d0097b3f8 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:51.386737 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-f2755d49-a1c1-4f74-a323-45298441d7b7 req-540e5a5a-5e44-47f0-92ff-103d0097b3f8 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:51.404322 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-f2755d49-a1c1-4f74-a323-45298441d7b7 req-540e5a5a-5e44-47f0-92ff-103d0097b3f8 service nova] Creating event network-vif-plugged:9fb05f00-cf2d-4b1f-936a-505b6cfc34bb for instance cb7e0f60-c90d-4cbc-aebb-e437add4adbf on hv-cinder-83625 Apr 12 00:34:51.411178 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-f2755d49-a1c1-4f74-a323-45298441d7b7 req-540e5a5a-5e44-47f0-92ff-103d0097b3f8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053892 Apr 12 00:34:51.412234 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 464/949] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:51.429241 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9cde7e2e-26a5-49cc-a66c-0af7b2016452 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:51.441137 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9cde7e2e-26a5-49cc-a66c-0af7b2016452 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:51.442696 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9cde7e2e-26a5-49cc-a66c-0af7b2016452 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:51.443897 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9cde7e2e-26a5-49cc-a66c-0af7b2016452 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1740 microversion: 2.20 time: 0.203695 Apr 12 00:34:51.455158 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 486/950] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:51 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:52.295964 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-cf54129c-0003-4a18-81eb-3762430491a2 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:52.296791 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-cf54129c-0003-4a18-81eb-3762430491a2 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:52.308577 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cf54129c-0003-4a18-81eb-3762430491a2 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:52.309061 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cf54129c-0003-4a18-81eb-3762430491a2 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:52.309947 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cf54129c-0003-4a18-81eb-3762430491a2 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:52.310482 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cf54129c-0003-4a18-81eb-3762430491a2 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:52.466795 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e62b878d-4e52-4d93-802a-3f5779e0efaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:52.467493 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-cf54129c-0003-4a18-81eb-3762430491a2 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713cc5554a6b4fa2a68d66006f907f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323743848f174ae7a70cc2d0952db4e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:52.468319 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e62b878d-4e52-4d93-802a-3f5779e0efaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:52.476412 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e62b878d-4e52-4d93-802a-3f5779e0efaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:52.477163 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e62b878d-4e52-4d93-802a-3f5779e0efaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:52.478054 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e62b878d-4e52-4d93-802a-3f5779e0efaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:52.479898 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e62b878d-4e52-4d93-802a-3f5779e0efaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:52.490812 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-cf54129c-0003-4a18-81eb-3762430491a2 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 200 len: 1314 microversion: 2.1 time: 0.199546 Apr 12 00:34:52.492042 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 465/951] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:52 2022] GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:52.627895 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e62b878d-4e52-4d93-802a-3f5779e0efaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:52.636514 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e62b878d-4e52-4d93-802a-3f5779e0efaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:52.638044 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e62b878d-4e52-4d93-802a-3f5779e0efaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:52.639275 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e62b878d-4e52-4d93-802a-3f5779e0efaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1740 microversion: 2.20 time: 0.180271 Apr 12 00:34:52.640006 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 487/952] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:52 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:34:53.510184 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-143d235d-2783-4c1b-8d11-dab73adf7a84 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:53.510895 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-143d235d-2783-4c1b-8d11-dab73adf7a84 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:53.519408 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-143d235d-2783-4c1b-8d11-dab73adf7a84 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:53.519867 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-143d235d-2783-4c1b-8d11-dab73adf7a84 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:53.520642 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-143d235d-2783-4c1b-8d11-dab73adf7a84 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:53.521078 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-143d235d-2783-4c1b-8d11-dab73adf7a84 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:53.657215 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ecb80161-a1c9-4a5a-b34a-812688757185 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:53.657990 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ecb80161-a1c9-4a5a-b34a-812688757185 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:53.664954 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ecb80161-a1c9-4a5a-b34a-812688757185 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:53.665407 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ecb80161-a1c9-4a5a-b34a-812688757185 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:53.666194 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ecb80161-a1c9-4a5a-b34a-812688757185 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:53.666658 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ecb80161-a1c9-4a5a-b34a-812688757185 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:53.675471 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-143d235d-2783-4c1b-8d11-dab73adf7a84 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713cc5554a6b4fa2a68d66006f907f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323743848f174ae7a70cc2d0952db4e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:53.690874 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-143d235d-2783-4c1b-8d11-dab73adf7a84 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 200 len: 1314 microversion: 2.1 time: 0.184491 Apr 12 00:34:53.691459 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 466/953] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:53 2022] GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:53.824718 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ecb80161-a1c9-4a5a-b34a-812688757185 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:53.832776 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ecb80161-a1c9-4a5a-b34a-812688757185 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:53.834439 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ecb80161-a1c9-4a5a-b34a-812688757185 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:53.835557 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ecb80161-a1c9-4a5a-b34a-812688757185 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1740 microversion: 2.20 time: 0.182363 Apr 12 00:34:53.836011 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 488/954] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:53 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:34:54.707652 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e8e142ce-f10a-42c9-868c-e04b5bfe1735 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:54.708875 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e8e142ce-f10a-42c9-868c-e04b5bfe1735 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:54.715660 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e8e142ce-f10a-42c9-868c-e04b5bfe1735 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:54.716383 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e8e142ce-f10a-42c9-868c-e04b5bfe1735 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:54.717401 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e8e142ce-f10a-42c9-868c-e04b5bfe1735 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:54.717903 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e8e142ce-f10a-42c9-868c-e04b5bfe1735 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:54.853184 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2875306c-4aae-45ab-827b-365eec99f173 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:54.853881 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-2875306c-4aae-45ab-827b-365eec99f173 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:54.860721 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2875306c-4aae-45ab-827b-365eec99f173 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:54.863854 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e8e142ce-f10a-42c9-868c-e04b5bfe1735 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713cc5554a6b4fa2a68d66006f907f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323743848f174ae7a70cc2d0952db4e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:54.866279 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2875306c-4aae-45ab-827b-365eec99f173 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:54.867098 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2875306c-4aae-45ab-827b-365eec99f173 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:54.867548 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2875306c-4aae-45ab-827b-365eec99f173 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:54.878755 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e8e142ce-f10a-42c9-868c-e04b5bfe1735 tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 200 len: 1464 microversion: 2.1 time: 0.174842 Apr 12 00:34:54.880005 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 467/955] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:54 2022] GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 1464 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:54.931651 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c1f0410e-6cd4-4708-85f1-ed762666507e tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:54.932222 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c1f0410e-6cd4-4708-85f1-ed762666507e tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:54.939164 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c1f0410e-6cd4-4708-85f1-ed762666507e tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:54.940335 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c1f0410e-6cd4-4708-85f1-ed762666507e tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:54.941195 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c1f0410e-6cd4-4708-85f1-ed762666507e tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:54.941689 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c1f0410e-6cd4-4708-85f1-ed762666507e tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:54.968740 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c1f0410e-6cd4-4708-85f1-ed762666507e tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Going to try to terminate instance {{(pid=128487) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:34:55.025241 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2875306c-4aae-45ab-827b-365eec99f173 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:55.033958 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2875306c-4aae-45ab-827b-365eec99f173 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:55.035650 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2875306c-4aae-45ab-827b-365eec99f173 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:55.036952 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2875306c-4aae-45ab-827b-365eec99f173 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1740 microversion: 2.20 time: 0.187630 Apr 12 00:34:55.037914 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 489/956] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:54 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:55.055685 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c1f0410e-6cd4-4708-85f1-ed762666507e tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 204 len: 0 microversion: 2.1 time: 0.127408 Apr 12 00:34:55.056577 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 468/957] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:34:54 2022] DELETE /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:34:55.065205 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f16badfc-c931-4021-bd43-b8a41c16df5a tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:55.065964 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f16badfc-c931-4021-bd43-b8a41c16df5a tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:55.072069 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f16badfc-c931-4021-bd43-b8a41c16df5a tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:55.072513 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f16badfc-c931-4021-bd43-b8a41c16df5a tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:55.073422 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f16badfc-c931-4021-bd43-b8a41c16df5a tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:55.073867 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f16badfc-c931-4021-bd43-b8a41c16df5a tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:55.220569 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f16badfc-c931-4021-bd43-b8a41c16df5a tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713cc5554a6b4fa2a68d66006f907f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323743848f174ae7a70cc2d0952db4e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:55.228035 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f16badfc-c931-4021-bd43-b8a41c16df5a tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 200 len: 1470 microversion: 2.1 time: 0.167108 Apr 12 00:34:55.228780 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 490/958] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:55 2022] GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:34:56.056647 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-66a7d229-5fc0-4e48-a5d5-44895cf1dbb8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:56.057354 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-66a7d229-5fc0-4e48-a5d5-44895cf1dbb8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:56.064080 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-66a7d229-5fc0-4e48-a5d5-44895cf1dbb8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:56.064687 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-66a7d229-5fc0-4e48-a5d5-44895cf1dbb8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:56.065191 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-66a7d229-5fc0-4e48-a5d5-44895cf1dbb8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:56.065632 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-66a7d229-5fc0-4e48-a5d5-44895cf1dbb8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:56.199775 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-66a7d229-5fc0-4e48-a5d5-44895cf1dbb8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:56.207916 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-66a7d229-5fc0-4e48-a5d5-44895cf1dbb8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:56.209405 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-66a7d229-5fc0-4e48-a5d5-44895cf1dbb8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:56.210617 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-66a7d229-5fc0-4e48-a5d5-44895cf1dbb8 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1740 microversion: 2.20 time: 0.159068 Apr 12 00:34:56.211181 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 469/959] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:56 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:56.246314 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-77922b0f-ae66-483f-8dcf-889f6371ee1a tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:56.246910 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-77922b0f-ae66-483f-8dcf-889f6371ee1a tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:56.253321 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-77922b0f-ae66-483f-8dcf-889f6371ee1a tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:56.253771 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-77922b0f-ae66-483f-8dcf-889f6371ee1a tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:56.254614 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-77922b0f-ae66-483f-8dcf-889f6371ee1a tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:56.255052 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-77922b0f-ae66-483f-8dcf-889f6371ee1a tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:56.392810 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-77922b0f-ae66-483f-8dcf-889f6371ee1a tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713cc5554a6b4fa2a68d66006f907f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323743848f174ae7a70cc2d0952db4e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:56.401193 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-77922b0f-ae66-483f-8dcf-889f6371ee1a tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 200 len: 1470 microversion: 2.1 time: 0.158797 Apr 12 00:34:56.412948 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 491/960] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:56 2022] GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:57.228952 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e726ef71-6184-47c8-b7d0-a01b954b66d9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:57.229569 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e726ef71-6184-47c8-b7d0-a01b954b66d9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:57.267302 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e726ef71-6184-47c8-b7d0-a01b954b66d9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:57.275968 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e726ef71-6184-47c8-b7d0-a01b954b66d9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:57.277084 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e726ef71-6184-47c8-b7d0-a01b954b66d9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:57.282284 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e726ef71-6184-47c8-b7d0-a01b954b66d9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:57.331867 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-a6c4b06c-5f8a-4b98-99f0-0c589f12bd5a req-eacb69ff-4c83-467e-b237-0a89899cf746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7e0f60-c90d-4cbc-aebb-e437add4adbf", "name": "network-vif-deleted", "tag": "9fb05f00-cf2d-4b1f-936a-505b6cfc34bb"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:57.345953 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-a6c4b06c-5f8a-4b98-99f0-0c589f12bd5a req-eacb69ff-4c83-467e-b237-0a89899cf746 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:57.346532 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-a6c4b06c-5f8a-4b98-99f0-0c589f12bd5a req-eacb69ff-4c83-467e-b237-0a89899cf746 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:57.367494 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-a6c4b06c-5f8a-4b98-99f0-0c589f12bd5a req-eacb69ff-4c83-467e-b237-0a89899cf746 service nova] Creating event network-vif-deleted:9fb05f00-cf2d-4b1f-936a-505b6cfc34bb for instance cb7e0f60-c90d-4cbc-aebb-e437add4adbf on hv-cinder-83625 Apr 12 00:34:57.376324 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-a6c4b06c-5f8a-4b98-99f0-0c589f12bd5a req-eacb69ff-4c83-467e-b237-0a89899cf746 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049009 Apr 12 00:34:57.377446 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 492/961] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:57.420320 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-367349cf-d708-4865-a9d3-206935437efc tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:57.421039 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-367349cf-d708-4865-a9d3-206935437efc tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:57.440147 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-367349cf-d708-4865-a9d3-206935437efc tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:57.441056 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-367349cf-d708-4865-a9d3-206935437efc tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:57.446807 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-367349cf-d708-4865-a9d3-206935437efc tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:57.447568 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-367349cf-d708-4865-a9d3-206935437efc tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:57.486601 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-367349cf-d708-4865-a9d3-206935437efc tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:57.487309 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-367349cf-d708-4865-a9d3-206935437efc tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:57.489053 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-367349cf-d708-4865-a9d3-206935437efc tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lazy-loading 'fault' on Instance uuid cb7e0f60-c90d-4cbc-aebb-e437add4adbf {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:34:57.523715 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e726ef71-6184-47c8-b7d0-a01b954b66d9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:57.533301 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e726ef71-6184-47c8-b7d0-a01b954b66d9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:57.538586 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e726ef71-6184-47c8-b7d0-a01b954b66d9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:57.539846 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e726ef71-6184-47c8-b7d0-a01b954b66d9 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1740 microversion: 2.20 time: 0.314748 Apr 12 00:34:57.547604 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-367349cf-d708-4865-a9d3-206935437efc tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713cc5554a6b4fa2a68d66006f907f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323743848f174ae7a70cc2d0952db4e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:57.553637 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 470/962] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:57 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1740 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:57.557012 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-367349cf-d708-4865-a9d3-206935437efc tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 200 len: 1304 microversion: 2.1 time: 0.141557 Apr 12 00:34:57.557683 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 493/963] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:57 2022] GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:58.557515 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-57bcf7b6-8484-4029-bd82-c11b52e509a1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:58.558123 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-57bcf7b6-8484-4029-bd82-c11b52e509a1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:58.564431 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-57bcf7b6-8484-4029-bd82-c11b52e509a1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:58.564878 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-57bcf7b6-8484-4029-bd82-c11b52e509a1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:58.565644 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-57bcf7b6-8484-4029-bd82-c11b52e509a1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:58.566081 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-57bcf7b6-8484-4029-bd82-c11b52e509a1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:58.575538 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c2e03e6d-0e16-42a0-9ec0-09018a6ded1b tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:58.576157 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c2e03e6d-0e16-42a0-9ec0-09018a6ded1b tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] [instance: cb7e0f60-c90d-4cbc-aebb-e437add4adbf] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:58.582166 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c2e03e6d-0e16-42a0-9ec0-09018a6ded1b tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:58.582660 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c2e03e6d-0e16-42a0-9ec0-09018a6ded1b tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:58.583490 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c2e03e6d-0e16-42a0-9ec0-09018a6ded1b tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:58.583931 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c2e03e6d-0e16-42a0-9ec0-09018a6ded1b tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:58.599123 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-c2e03e6d-0e16-42a0-9ec0-09018a6ded1b tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] HTTP exception thrown: Instance cb7e0f60-c90d-4cbc-aebb-e437add4adbf could not be found. Apr 12 00:34:58.599887 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c2e03e6d-0e16-42a0-9ec0-09018a6ded1b tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] Returning 404 to user: Instance cb7e0f60-c90d-4cbc-aebb-e437add4adbf could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:34:58.600817 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c2e03e6d-0e16-42a0-9ec0-09018a6ded1b tempest-VolumesNegativeTest-459278637 tempest-VolumesNegativeTest-459278637-project] 10.222.0.32 "GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf" status: 404 len: 111 microversion: 2.1 time: 0.029526 Apr 12 00:34:58.601306 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 494/964] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:34:58 2022] GET /compute/v2.1/servers/cb7e0f60-c90d-4cbc-aebb-e437add4adbf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 00:34:58.706204 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-57bcf7b6-8484-4029-bd82-c11b52e509a1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:58.714205 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-57bcf7b6-8484-4029-bd82-c11b52e509a1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:58.715750 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-57bcf7b6-8484-4029-bd82-c11b52e509a1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:58.716909 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-57bcf7b6-8484-4029-bd82-c11b52e509a1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1740 microversion: 2.20 time: 0.163308 Apr 12 00:34:58.717473 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 471/965] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:58 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:59.735679 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-dcd34a57-27df-459e-a37f-87fd6563483d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:59.737029 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-dcd34a57-27df-459e-a37f-87fd6563483d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:34:59.744465 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dcd34a57-27df-459e-a37f-87fd6563483d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:59.745098 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dcd34a57-27df-459e-a37f-87fd6563483d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:59.746170 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dcd34a57-27df-459e-a37f-87fd6563483d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:34:59.747165 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dcd34a57-27df-459e-a37f-87fd6563483d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:34:59.890063 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-dcd34a57-27df-459e-a37f-87fd6563483d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:59.898437 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-dcd34a57-27df-459e-a37f-87fd6563483d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:59.899934 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-dcd34a57-27df-459e-a37f-87fd6563483d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:34:59.901127 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-dcd34a57-27df-459e-a37f-87fd6563483d tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1722 microversion: 2.20 time: 0.169363 Apr 12 00:34:59.902292 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 495/966] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:34:59 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:00.921301 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-0813d28f-eeef-4232-a7f3-1aada57a737e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:00.921301 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-0813d28f-eeef-4232-a7f3-1aada57a737e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:00.927480 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0813d28f-eeef-4232-a7f3-1aada57a737e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:00.927952 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0813d28f-eeef-4232-a7f3-1aada57a737e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:00.928651 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0813d28f-eeef-4232-a7f3-1aada57a737e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:00.929086 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0813d28f-eeef-4232-a7f3-1aada57a737e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:01.065128 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-0813d28f-eeef-4232-a7f3-1aada57a737e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:01.072692 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-0813d28f-eeef-4232-a7f3-1aada57a737e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:01.074185 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-0813d28f-eeef-4232-a7f3-1aada57a737e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:01.075381 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-0813d28f-eeef-4232-a7f3-1aada57a737e tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1722 microversion: 2.20 time: 0.159928 Apr 12 00:35:01.075944 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 472/967] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:00 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:02.093764 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8d5afb6e-04ee-4848-9097-57d62a5df684 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:02.094415 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8d5afb6e-04ee-4848-9097-57d62a5df684 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:02.101223 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8d5afb6e-04ee-4848-9097-57d62a5df684 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:02.101679 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8d5afb6e-04ee-4848-9097-57d62a5df684 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:02.102473 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8d5afb6e-04ee-4848-9097-57d62a5df684 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:02.102916 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8d5afb6e-04ee-4848-9097-57d62a5df684 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:02.235243 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8d5afb6e-04ee-4848-9097-57d62a5df684 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:02.244453 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8d5afb6e-04ee-4848-9097-57d62a5df684 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:02.246241 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8d5afb6e-04ee-4848-9097-57d62a5df684 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:02.247426 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8d5afb6e-04ee-4848-9097-57d62a5df684 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1725 microversion: 2.20 time: 0.157534 Apr 12 00:35:02.247979 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 496/968] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:02 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:02.265277 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-8203c3b7-9953-4d6e-a139-fd8d5c2a65c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e2beeab-0c11-4ab9-ac69-e0cacd80f16e"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:02.266747 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-8203c3b7-9953-4d6e-a139-fd8d5c2a65c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:02.273044 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8203c3b7-9953-4d6e-a139-fd8d5c2a65c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:02.273561 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8203c3b7-9953-4d6e-a139-fd8d5c2a65c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:02.274396 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8203c3b7-9953-4d6e-a139-fd8d5c2a65c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:02.274829 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8203c3b7-9953-4d6e-a139-fd8d5c2a65c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:02.536579 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-8203c3b7-9953-4d6e-a139-fd8d5c2a65c5 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "POST /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.275105 Apr 12 00:35:02.537175 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 473/969] 10.222.0.32 () {62 vars in 1363 bytes} [Tue Apr 12 00:35:02 2022] POST /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29/os-volume_attachments => generated 188 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:35:02.653970 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-10ce9b8b-c7b1-4df2-9076-5d8555bc7dfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:02.654588 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-10ce9b8b-c7b1-4df2-9076-5d8555bc7dfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:02.660786 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-10ce9b8b-c7b1-4df2-9076-5d8555bc7dfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:02.661406 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-10ce9b8b-c7b1-4df2-9076-5d8555bc7dfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:02.662088 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-10ce9b8b-c7b1-4df2-9076-5d8555bc7dfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:02.662570 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-10ce9b8b-c7b1-4df2-9076-5d8555bc7dfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:02.925055 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-10ce9b8b-c7b1-4df2-9076-5d8555bc7dfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29/os-volume_attachments/6e2beeab-0c11-4ab9-ac69-e0cacd80f16e" status: 202 len: 0 microversion: 2.20 time: 0.274780 Apr 12 00:35:02.925824 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 497/970] 10.222.0.32 () {60 vars in 1456 bytes} [Tue Apr 12 00:35:02 2022] DELETE /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29/os-volume_attachments/6e2beeab-0c11-4ab9-ac69-e0cacd80f16e => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:35:02.980996 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-821cfa8e-0f07-4044-8925-defe07b1d895 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:02.981561 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-821cfa8e-0f07-4044-8925-defe07b1d895 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:02.988034 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-821cfa8e-0f07-4044-8925-defe07b1d895 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:02.988480 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-821cfa8e-0f07-4044-8925-defe07b1d895 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:02.989232 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-821cfa8e-0f07-4044-8925-defe07b1d895 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:02.989669 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-821cfa8e-0f07-4044-8925-defe07b1d895 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:03.063133 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-821cfa8e-0f07-4044-8925-defe07b1d895 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "POST /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29/action" status: 202 len: 0 microversion: 2.20 time: 0.085948 Apr 12 00:35:03.063682 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 474/971] 10.222.0.32 () {62 vars in 1318 bytes} [Tue Apr 12 00:35:02 2022] POST /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:35:03.072427 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a2c9a09b-0320-459c-bcd1-81140e87696a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:03.073075 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a2c9a09b-0320-459c-bcd1-81140e87696a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:03.078957 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a2c9a09b-0320-459c-bcd1-81140e87696a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:03.079415 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a2c9a09b-0320-459c-bcd1-81140e87696a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:03.080189 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a2c9a09b-0320-459c-bcd1-81140e87696a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:03.080627 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a2c9a09b-0320-459c-bcd1-81140e87696a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:03.214392 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a2c9a09b-0320-459c-bcd1-81140e87696a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:03.223414 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a2c9a09b-0320-459c-bcd1-81140e87696a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:03.225155 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a2c9a09b-0320-459c-bcd1-81140e87696a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:03.226469 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a2c9a09b-0320-459c-bcd1-81140e87696a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1673 microversion: 2.20 time: 0.157986 Apr 12 00:35:03.227119 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 498/972] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:03 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:03.299389 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-1bd9fa75-2997-41dc-9bc5-5420babe6a92 req-859d27ca-8ded-464c-88ef-562308f52a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd000ee-5205-4d02-b7a8-8c99871c8f29", "name": "network-vif-unplugged", "status": "completed", "tag": "0e9155b9-7112-41cd-b8ec-dd359b342b3a"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:03.309372 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-1bd9fa75-2997-41dc-9bc5-5420babe6a92 req-859d27ca-8ded-464c-88ef-562308f52a5a service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:03.310009 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-1bd9fa75-2997-41dc-9bc5-5420babe6a92 req-859d27ca-8ded-464c-88ef-562308f52a5a service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:03.324668 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.compute.server_external_events [req-1bd9fa75-2997-41dc-9bc5-5420babe6a92 req-859d27ca-8ded-464c-88ef-562308f52a5a service nova] Unable to find a host for instance 6fd000ee-5205-4d02-b7a8-8c99871c8f29. Dropping event network-vif-unplugged {{(pid=128487) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 12 00:35:03.325909 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-1bd9fa75-2997-41dc-9bc5-5420babe6a92 req-859d27ca-8ded-464c-88ef-562308f52a5a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030905 Apr 12 00:35:03.327053 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 475/973] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 12 00:35:04.244947 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9244b155-88fb-4ab8-8fd8-083500ba0a8b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:04.245609 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9244b155-88fb-4ab8-8fd8-083500ba0a8b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:04.251849 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9244b155-88fb-4ab8-8fd8-083500ba0a8b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:04.252298 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9244b155-88fb-4ab8-8fd8-083500ba0a8b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:04.253086 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9244b155-88fb-4ab8-8fd8-083500ba0a8b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:04.253503 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9244b155-88fb-4ab8-8fd8-083500ba0a8b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:04.380354 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9244b155-88fb-4ab8-8fd8-083500ba0a8b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:04.388249 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9244b155-88fb-4ab8-8fd8-083500ba0a8b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:04.389739 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9244b155-88fb-4ab8-8fd8-083500ba0a8b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:04.391170 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9244b155-88fb-4ab8-8fd8-083500ba0a8b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.149950 Apr 12 00:35:04.391970 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 499/974] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:04 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:05.410211 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-574c0b0f-d0aa-42f4-973e-351341b31511 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:05.411596 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-574c0b0f-d0aa-42f4-973e-351341b31511 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:05.419548 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-574c0b0f-d0aa-42f4-973e-351341b31511 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:05.420122 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-574c0b0f-d0aa-42f4-973e-351341b31511 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:05.421000 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-574c0b0f-d0aa-42f4-973e-351341b31511 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:05.421538 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-574c0b0f-d0aa-42f4-973e-351341b31511 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:05.561555 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-574c0b0f-d0aa-42f4-973e-351341b31511 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:05.570165 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-574c0b0f-d0aa-42f4-973e-351341b31511 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:05.571677 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-574c0b0f-d0aa-42f4-973e-351341b31511 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:05.572829 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-574c0b0f-d0aa-42f4-973e-351341b31511 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.166725 Apr 12 00:35:05.573390 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 476/975] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:05 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:06.591409 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-21d04975-b8cf-49cc-bbe2-7ec03cb63649 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:06.592009 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-21d04975-b8cf-49cc-bbe2-7ec03cb63649 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:06.599923 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-21d04975-b8cf-49cc-bbe2-7ec03cb63649 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:06.600370 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-21d04975-b8cf-49cc-bbe2-7ec03cb63649 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:06.601342 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-21d04975-b8cf-49cc-bbe2-7ec03cb63649 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:06.601992 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-21d04975-b8cf-49cc-bbe2-7ec03cb63649 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:06.737554 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-21d04975-b8cf-49cc-bbe2-7ec03cb63649 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:06.746652 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-21d04975-b8cf-49cc-bbe2-7ec03cb63649 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:06.748237 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-21d04975-b8cf-49cc-bbe2-7ec03cb63649 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:06.749410 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-21d04975-b8cf-49cc-bbe2-7ec03cb63649 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.162158 Apr 12 00:35:06.749979 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 500/976] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:06 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:07.769969 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-dcd37226-d056-4cfe-b3fa-6d7ca08a1b03 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:07.771248 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-dcd37226-d056-4cfe-b3fa-6d7ca08a1b03 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:07.777505 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dcd37226-d056-4cfe-b3fa-6d7ca08a1b03 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:07.778078 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dcd37226-d056-4cfe-b3fa-6d7ca08a1b03 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:07.778960 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dcd37226-d056-4cfe-b3fa-6d7ca08a1b03 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:07.779466 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dcd37226-d056-4cfe-b3fa-6d7ca08a1b03 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:07.932365 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-dcd37226-d056-4cfe-b3fa-6d7ca08a1b03 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:07.941402 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-dcd37226-d056-4cfe-b3fa-6d7ca08a1b03 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:07.942997 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-dcd37226-d056-4cfe-b3fa-6d7ca08a1b03 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:07.944184 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-dcd37226-d056-4cfe-b3fa-6d7ca08a1b03 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.180038 Apr 12 00:35:07.944960 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 477/977] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:07 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:08.962745 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c6c57766-30eb-4f1b-9abd-81cc538ce1d4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:08.963406 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c6c57766-30eb-4f1b-9abd-81cc538ce1d4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:08.970296 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c6c57766-30eb-4f1b-9abd-81cc538ce1d4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:08.970755 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c6c57766-30eb-4f1b-9abd-81cc538ce1d4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:08.971523 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c6c57766-30eb-4f1b-9abd-81cc538ce1d4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:08.971952 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c6c57766-30eb-4f1b-9abd-81cc538ce1d4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:09.106019 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-c6c57766-30eb-4f1b-9abd-81cc538ce1d4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:09.114117 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-c6c57766-30eb-4f1b-9abd-81cc538ce1d4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:09.115710 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-c6c57766-30eb-4f1b-9abd-81cc538ce1d4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:09.117108 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c6c57766-30eb-4f1b-9abd-81cc538ce1d4 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.158411 Apr 12 00:35:09.121692 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 501/978] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:08 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:10.135011 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9acc82e4-3362-4377-a5ac-42f3d787285c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:10.135867 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-9acc82e4-3362-4377-a5ac-42f3d787285c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:10.143518 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9acc82e4-3362-4377-a5ac-42f3d787285c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:10.144132 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9acc82e4-3362-4377-a5ac-42f3d787285c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:10.145067 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9acc82e4-3362-4377-a5ac-42f3d787285c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:10.145653 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9acc82e4-3362-4377-a5ac-42f3d787285c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:10.278343 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9acc82e4-3362-4377-a5ac-42f3d787285c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:10.288829 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9acc82e4-3362-4377-a5ac-42f3d787285c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:10.290353 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9acc82e4-3362-4377-a5ac-42f3d787285c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:10.291833 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9acc82e4-3362-4377-a5ac-42f3d787285c tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.160769 Apr 12 00:35:10.292395 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 478/979] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:10 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:11.310649 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8430ea8c-438f-4d83-842e-28ca5bdaddaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:11.311373 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8430ea8c-438f-4d83-842e-28ca5bdaddaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:11.317848 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8430ea8c-438f-4d83-842e-28ca5bdaddaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:11.318346 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8430ea8c-438f-4d83-842e-28ca5bdaddaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:11.319153 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8430ea8c-438f-4d83-842e-28ca5bdaddaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:11.319579 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8430ea8c-438f-4d83-842e-28ca5bdaddaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:11.461894 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8430ea8c-438f-4d83-842e-28ca5bdaddaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:11.473308 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8430ea8c-438f-4d83-842e-28ca5bdaddaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:11.475458 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8430ea8c-438f-4d83-842e-28ca5bdaddaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:11.476722 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8430ea8c-438f-4d83-842e-28ca5bdaddaf tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.169944 Apr 12 00:35:11.477371 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 502/980] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:11 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:12.495754 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f8993ce0-bcc9-451d-a6fa-f64a9b8d12c7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:12.496714 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f8993ce0-bcc9-451d-a6fa-f64a9b8d12c7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:12.504550 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f8993ce0-bcc9-451d-a6fa-f64a9b8d12c7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:12.505091 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f8993ce0-bcc9-451d-a6fa-f64a9b8d12c7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:12.506022 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f8993ce0-bcc9-451d-a6fa-f64a9b8d12c7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:12.506829 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f8993ce0-bcc9-451d-a6fa-f64a9b8d12c7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:12.648737 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f8993ce0-bcc9-451d-a6fa-f64a9b8d12c7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:12.657832 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f8993ce0-bcc9-451d-a6fa-f64a9b8d12c7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:12.659049 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f8993ce0-bcc9-451d-a6fa-f64a9b8d12c7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:12.660251 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f8993ce0-bcc9-451d-a6fa-f64a9b8d12c7 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.168526 Apr 12 00:35:12.670684 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 479/981] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:12 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:13.678660 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0bd35d09-c7e8-429e-af06-2cb4e5e15917 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:13.680065 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0bd35d09-c7e8-429e-af06-2cb4e5e15917 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:13.686431 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0bd35d09-c7e8-429e-af06-2cb4e5e15917 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:13.686961 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0bd35d09-c7e8-429e-af06-2cb4e5e15917 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:13.687806 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0bd35d09-c7e8-429e-af06-2cb4e5e15917 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:13.688814 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0bd35d09-c7e8-429e-af06-2cb4e5e15917 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:13.814491 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0bd35d09-c7e8-429e-af06-2cb4e5e15917 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:13.822738 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0bd35d09-c7e8-429e-af06-2cb4e5e15917 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:13.824259 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0bd35d09-c7e8-429e-af06-2cb4e5e15917 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:13.825444 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0bd35d09-c7e8-429e-af06-2cb4e5e15917 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.150650 Apr 12 00:35:13.826207 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 503/982] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:13 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:14.844159 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-bbf805fe-6646-4738-9b54-8417217bf634 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:14.844771 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-bbf805fe-6646-4738-9b54-8417217bf634 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:14.851109 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bbf805fe-6646-4738-9b54-8417217bf634 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:14.851558 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bbf805fe-6646-4738-9b54-8417217bf634 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:14.852308 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bbf805fe-6646-4738-9b54-8417217bf634 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:14.852737 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bbf805fe-6646-4738-9b54-8417217bf634 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:14.978054 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-bbf805fe-6646-4738-9b54-8417217bf634 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:14.986271 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-bbf805fe-6646-4738-9b54-8417217bf634 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:14.987761 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-bbf805fe-6646-4738-9b54-8417217bf634 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:14.988898 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-bbf805fe-6646-4738-9b54-8417217bf634 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.148708 Apr 12 00:35:14.989455 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 480/983] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:14 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:16.006333 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-67dd65be-5dde-456e-a038-cc23c0a29515 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:16.006920 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-67dd65be-5dde-456e-a038-cc23c0a29515 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:16.013138 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-67dd65be-5dde-456e-a038-cc23c0a29515 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:16.013582 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-67dd65be-5dde-456e-a038-cc23c0a29515 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:16.014364 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-67dd65be-5dde-456e-a038-cc23c0a29515 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:16.014795 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-67dd65be-5dde-456e-a038-cc23c0a29515 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:16.140236 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-67dd65be-5dde-456e-a038-cc23c0a29515 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:16.148192 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-67dd65be-5dde-456e-a038-cc23c0a29515 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:16.149680 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-67dd65be-5dde-456e-a038-cc23c0a29515 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:16.150841 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-67dd65be-5dde-456e-a038-cc23c0a29515 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.148442 Apr 12 00:35:16.151404 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 504/984] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:16 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:17.168884 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-eaf4f7e3-08fb-4386-b8d9-365dcc0e69e1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:17.169488 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-eaf4f7e3-08fb-4386-b8d9-365dcc0e69e1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:17.176044 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-eaf4f7e3-08fb-4386-b8d9-365dcc0e69e1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:17.176512 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-eaf4f7e3-08fb-4386-b8d9-365dcc0e69e1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:17.177262 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-eaf4f7e3-08fb-4386-b8d9-365dcc0e69e1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:17.177692 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-eaf4f7e3-08fb-4386-b8d9-365dcc0e69e1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:17.301582 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-eaf4f7e3-08fb-4386-b8d9-365dcc0e69e1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:17.309249 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-eaf4f7e3-08fb-4386-b8d9-365dcc0e69e1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:17.310752 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-eaf4f7e3-08fb-4386-b8d9-365dcc0e69e1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:17.311882 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-eaf4f7e3-08fb-4386-b8d9-365dcc0e69e1 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.146929 Apr 12 00:35:17.312445 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 481/985] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:17 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:18.332754 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-dd534b3c-9a2c-40db-bde8-480258266a6a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:18.333465 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-dd534b3c-9a2c-40db-bde8-480258266a6a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:18.339938 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dd534b3c-9a2c-40db-bde8-480258266a6a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:18.340407 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dd534b3c-9a2c-40db-bde8-480258266a6a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:18.341223 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dd534b3c-9a2c-40db-bde8-480258266a6a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:18.341655 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-dd534b3c-9a2c-40db-bde8-480258266a6a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:18.468350 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-dd534b3c-9a2c-40db-bde8-480258266a6a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:18.476062 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-dd534b3c-9a2c-40db-bde8-480258266a6a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:18.477553 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-dd534b3c-9a2c-40db-bde8-480258266a6a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:18.478728 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-dd534b3c-9a2c-40db-bde8-480258266a6a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.151204 Apr 12 00:35:18.479295 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 505/986] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:18 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:19.496888 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-cee2086f-f2f8-4489-9015-dc60e8725346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:19.497498 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-cee2086f-f2f8-4489-9015-dc60e8725346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:19.504997 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cee2086f-f2f8-4489-9015-dc60e8725346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:19.505447 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cee2086f-f2f8-4489-9015-dc60e8725346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:19.506208 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cee2086f-f2f8-4489-9015-dc60e8725346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:19.506671 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cee2086f-f2f8-4489-9015-dc60e8725346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:19.632731 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-cee2086f-f2f8-4489-9015-dc60e8725346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:19.640342 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-cee2086f-f2f8-4489-9015-dc60e8725346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:19.643050 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-cee2086f-f2f8-4489-9015-dc60e8725346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:19.644196 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-cee2086f-f2f8-4489-9015-dc60e8725346 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.151222 Apr 12 00:35:19.644758 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 482/987] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:19 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:20.662502 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-39fe154b-9854-445a-896b-ed94ad8fef37 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:20.663110 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-39fe154b-9854-445a-896b-ed94ad8fef37 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:20.669352 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-39fe154b-9854-445a-896b-ed94ad8fef37 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:20.669792 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-39fe154b-9854-445a-896b-ed94ad8fef37 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:20.670606 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-39fe154b-9854-445a-896b-ed94ad8fef37 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:20.671037 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-39fe154b-9854-445a-896b-ed94ad8fef37 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:20.797012 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-39fe154b-9854-445a-896b-ed94ad8fef37 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:20.805179 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-39fe154b-9854-445a-896b-ed94ad8fef37 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:20.806764 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-39fe154b-9854-445a-896b-ed94ad8fef37 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:20.807906 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-39fe154b-9854-445a-896b-ed94ad8fef37 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.149367 Apr 12 00:35:20.808466 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 506/988] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:20 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:21.826789 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-58e75ee5-724d-4f16-8540-8f675297f42f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:21.827339 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-58e75ee5-724d-4f16-8540-8f675297f42f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:21.834167 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-58e75ee5-724d-4f16-8540-8f675297f42f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:21.834639 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-58e75ee5-724d-4f16-8540-8f675297f42f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:21.835418 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-58e75ee5-724d-4f16-8540-8f675297f42f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:21.835847 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-58e75ee5-724d-4f16-8540-8f675297f42f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:21.959423 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-58e75ee5-724d-4f16-8540-8f675297f42f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:21.967253 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-58e75ee5-724d-4f16-8540-8f675297f42f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:21.968726 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-58e75ee5-724d-4f16-8540-8f675297f42f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:21.969876 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-58e75ee5-724d-4f16-8540-8f675297f42f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.147071 Apr 12 00:35:21.970660 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 483/989] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:21 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:22.988082 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-22ef9d75-95dc-4938-9712-e3ebf8f08b64 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:22.988689 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-22ef9d75-95dc-4938-9712-e3ebf8f08b64 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:22.995011 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-22ef9d75-95dc-4938-9712-e3ebf8f08b64 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:22.995453 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-22ef9d75-95dc-4938-9712-e3ebf8f08b64 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:22.996206 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-22ef9d75-95dc-4938-9712-e3ebf8f08b64 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:22.996638 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-22ef9d75-95dc-4938-9712-e3ebf8f08b64 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:23.119754 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-22ef9d75-95dc-4938-9712-e3ebf8f08b64 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:23.127955 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-22ef9d75-95dc-4938-9712-e3ebf8f08b64 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:23.129444 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-22ef9d75-95dc-4938-9712-e3ebf8f08b64 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:23.130609 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-22ef9d75-95dc-4938-9712-e3ebf8f08b64 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.146402 Apr 12 00:35:23.131167 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 507/990] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:22 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:23.420764 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-0e4902e4-e73d-4238-8ce3-9c7c3253e64c req-4faee16b-49e1-4c46-b9cc-ad5e0a605c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd000ee-5205-4d02-b7a8-8c99871c8f29", "name": "network-vif-plugged", "status": "completed", "tag": "0e9155b9-7112-41cd-b8ec-dd359b342b3a"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:23.429795 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-0e4902e4-e73d-4238-8ce3-9c7c3253e64c req-4faee16b-49e1-4c46-b9cc-ad5e0a605c9a service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:23.430267 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-0e4902e4-e73d-4238-8ce3-9c7c3253e64c req-4faee16b-49e1-4c46-b9cc-ad5e0a605c9a service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:23.444028 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-0e4902e4-e73d-4238-8ce3-9c7c3253e64c req-4faee16b-49e1-4c46-b9cc-ad5e0a605c9a service nova] Creating event network-vif-plugged:0e9155b9-7112-41cd-b8ec-dd359b342b3a for instance 6fd000ee-5205-4d02-b7a8-8c99871c8f29 on hv-cinder-83625 Apr 12 00:35:23.449132 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-0e4902e4-e73d-4238-8ce3-9c7c3253e64c req-4faee16b-49e1-4c46-b9cc-ad5e0a605c9a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032495 Apr 12 00:35:23.449928 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 484/991] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:24.148830 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a6604ff0-05bc-4b33-ac06-0f423ee4edc2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:24.149463 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a6604ff0-05bc-4b33-ac06-0f423ee4edc2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:24.155713 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a6604ff0-05bc-4b33-ac06-0f423ee4edc2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:24.156161 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a6604ff0-05bc-4b33-ac06-0f423ee4edc2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:24.156966 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a6604ff0-05bc-4b33-ac06-0f423ee4edc2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:24.157399 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a6604ff0-05bc-4b33-ac06-0f423ee4edc2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:24.282388 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a6604ff0-05bc-4b33-ac06-0f423ee4edc2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:24.290031 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a6604ff0-05bc-4b33-ac06-0f423ee4edc2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:24.291568 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a6604ff0-05bc-4b33-ac06-0f423ee4edc2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:24.292713 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a6604ff0-05bc-4b33-ac06-0f423ee4edc2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.147829 Apr 12 00:35:24.293277 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 508/992] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:24 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:25.311993 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-bbb52da7-f59d-48e2-aa7c-85c23ba1e716 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:25.312684 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-bbb52da7-f59d-48e2-aa7c-85c23ba1e716 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:25.319657 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bbb52da7-f59d-48e2-aa7c-85c23ba1e716 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:25.320097 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bbb52da7-f59d-48e2-aa7c-85c23ba1e716 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:25.320846 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bbb52da7-f59d-48e2-aa7c-85c23ba1e716 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:25.321304 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bbb52da7-f59d-48e2-aa7c-85c23ba1e716 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:25.444008 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-bbb52da7-f59d-48e2-aa7c-85c23ba1e716 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:25.451771 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-bbb52da7-f59d-48e2-aa7c-85c23ba1e716 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:25.453306 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-bbb52da7-f59d-48e2-aa7c-85c23ba1e716 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:25.454479 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-bbb52da7-f59d-48e2-aa7c-85c23ba1e716 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1731 microversion: 2.20 time: 0.146774 Apr 12 00:35:25.455045 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 485/993] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:25 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:35:26.473134 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4376b0d6-bc03-4afe-a3ae-aa09291bb607 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:26.473663 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4376b0d6-bc03-4afe-a3ae-aa09291bb607 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:26.479875 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4376b0d6-bc03-4afe-a3ae-aa09291bb607 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:26.480320 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4376b0d6-bc03-4afe-a3ae-aa09291bb607 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:26.481072 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4376b0d6-bc03-4afe-a3ae-aa09291bb607 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:26.481506 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4376b0d6-bc03-4afe-a3ae-aa09291bb607 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:26.603518 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4376b0d6-bc03-4afe-a3ae-aa09291bb607 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:26.611196 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4376b0d6-bc03-4afe-a3ae-aa09291bb607 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:26.612733 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4376b0d6-bc03-4afe-a3ae-aa09291bb607 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:26.613878 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4376b0d6-bc03-4afe-a3ae-aa09291bb607 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1718 microversion: 2.20 time: 0.145381 Apr 12 00:35:26.614462 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 509/994] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:35:26 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:29.226494 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-cdecd1c5-0571-4606-a088-7878b454975a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:29.227047 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-cdecd1c5-0571-4606-a088-7878b454975a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:29.228743 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-c9153575-f17d-460e-b512-64602ce23850 req-26430fe4-443e-4066-b684-f3f303ef14b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29aa1426-1684-47b1-aded-1c9c306543bc", "tag": "94406837-92d7-472c-9764-43cc0c5b4cd8"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:29.233451 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cdecd1c5-0571-4606-a088-7878b454975a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:29.234024 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cdecd1c5-0571-4606-a088-7878b454975a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:29.234866 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cdecd1c5-0571-4606-a088-7878b454975a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:29.235374 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cdecd1c5-0571-4606-a088-7878b454975a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:29.236937 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-c9153575-f17d-460e-b512-64602ce23850 req-26430fe4-443e-4066-b684-f3f303ef14b1 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:29.237384 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-c9153575-f17d-460e-b512-64602ce23850 req-26430fe4-443e-4066-b684-f3f303ef14b1 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:29.248190 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-c9153575-f17d-460e-b512-64602ce23850 req-26430fe4-443e-4066-b684-f3f303ef14b1 service nova] Creating event network-changed:94406837-92d7-472c-9764-43cc0c5b4cd8 for instance 29aa1426-1684-47b1-aded-1c9c306543bc on hv-cinder-83625 Apr 12 00:35:29.253960 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-c9153575-f17d-460e-b512-64602ce23850 req-26430fe4-443e-4066-b684-f3f303ef14b1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029027 Apr 12 00:35:29.254910 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 510/995] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:29.263002 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-cdecd1c5-0571-4606-a088-7878b454975a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Going to try to terminate instance {{(pid=128487) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:35:29.346942 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-cdecd1c5-0571-4606-a088-7878b454975a tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "DELETE /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 204 len: 0 microversion: 2.1 time: 0.124038 Apr 12 00:35:29.347731 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 486/996] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:35:29 2022] DELETE /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 00:35:29.357247 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-37037a0e-71f4-4a00-bf33-0b3c2062bde2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:29.358185 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-37037a0e-71f4-4a00-bf33-0b3c2062bde2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:29.365216 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-37037a0e-71f4-4a00-bf33-0b3c2062bde2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:29.365669 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-37037a0e-71f4-4a00-bf33-0b3c2062bde2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:29.366471 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-37037a0e-71f4-4a00-bf33-0b3c2062bde2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:29.366907 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-37037a0e-71f4-4a00-bf33-0b3c2062bde2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:29.496227 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-37037a0e-71f4-4a00-bf33-0b3c2062bde2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:29.504053 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-37037a0e-71f4-4a00-bf33-0b3c2062bde2 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1566 microversion: 2.1 time: 0.151502 Apr 12 00:35:29.504628 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 511/997] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:35:29 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:35:30.522748 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-015f1a5b-f1af-4fe9-9024-c49d0dfe2349 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:30.523447 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-015f1a5b-f1af-4fe9-9024-c49d0dfe2349 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:30.529605 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-015f1a5b-f1af-4fe9-9024-c49d0dfe2349 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:30.530060 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-015f1a5b-f1af-4fe9-9024-c49d0dfe2349 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:30.530854 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-015f1a5b-f1af-4fe9-9024-c49d0dfe2349 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:30.531314 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-015f1a5b-f1af-4fe9-9024-c49d0dfe2349 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:30.717772 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-015f1a5b-f1af-4fe9-9024-c49d0dfe2349 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:30.725164 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-015f1a5b-f1af-4fe9-9024-c49d0dfe2349 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1566 microversion: 2.1 time: 0.206731 Apr 12 00:35:30.725734 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 487/998] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:35:30 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1566 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:35:31.742317 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-92f1f15d-bc1d-4934-8f31-f8f55c4f4087 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:31.742941 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-92f1f15d-bc1d-4934-8f31-f8f55c4f4087 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:31.749203 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-92f1f15d-bc1d-4934-8f31-f8f55c4f4087 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:31.749656 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-92f1f15d-bc1d-4934-8f31-f8f55c4f4087 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:31.750515 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-92f1f15d-bc1d-4934-8f31-f8f55c4f4087 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:31.750956 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-92f1f15d-bc1d-4934-8f31-f8f55c4f4087 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:31.886213 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-92f1f15d-bc1d-4934-8f31-f8f55c4f4087 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee7971dfb4e4c22aac3d97db9ee04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03f71e524b24b8abf5e7c81842f4e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:35:31.894465 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-92f1f15d-bc1d-4934-8f31-f8f55c4f4087 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 200 len: 1448 microversion: 2.1 time: 0.155897 Apr 12 00:35:31.895035 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 512/999] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:35:31 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 1448 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:35:31.913894 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-42a18510-538d-495e-8361-70793547ab63 req-600e2ce2-d6f4-4bd2-bd7a-50a00e01f6bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29aa1426-1684-47b1-aded-1c9c306543bc", "name": "network-vif-deleted", "tag": "94406837-92d7-472c-9764-43cc0c5b4cd8"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:31.923251 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-42a18510-538d-495e-8361-70793547ab63 req-600e2ce2-d6f4-4bd2-bd7a-50a00e01f6bc service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:31.923635 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-42a18510-538d-495e-8361-70793547ab63 req-600e2ce2-d6f4-4bd2-bd7a-50a00e01f6bc service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:31.934758 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-42a18510-538d-495e-8361-70793547ab63 req-600e2ce2-d6f4-4bd2-bd7a-50a00e01f6bc service nova] Creating event network-vif-deleted:94406837-92d7-472c-9764-43cc0c5b4cd8 for instance 29aa1426-1684-47b1-aded-1c9c306543bc on hv-cinder-83625 Apr 12 00:35:31.939974 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-42a18510-538d-495e-8361-70793547ab63 req-600e2ce2-d6f4-4bd2-bd7a-50a00e01f6bc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029650 Apr 12 00:35:31.940664 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 488/1000] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:32.911429 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-70d2693c-2b8f-401e-9757-8ef52036316f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:32.912038 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-70d2693c-2b8f-401e-9757-8ef52036316f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] [instance: 29aa1426-1684-47b1-aded-1c9c306543bc] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:32.918313 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-70d2693c-2b8f-401e-9757-8ef52036316f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:32.918783 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-70d2693c-2b8f-401e-9757-8ef52036316f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:32.919583 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-70d2693c-2b8f-401e-9757-8ef52036316f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:32.919973 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-70d2693c-2b8f-401e-9757-8ef52036316f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:32.934772 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-70d2693c-2b8f-401e-9757-8ef52036316f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] HTTP exception thrown: Instance 29aa1426-1684-47b1-aded-1c9c306543bc could not be found. Apr 12 00:35:32.935356 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-70d2693c-2b8f-401e-9757-8ef52036316f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Returning 404 to user: Instance 29aa1426-1684-47b1-aded-1c9c306543bc could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:35:32.936167 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-70d2693c-2b8f-401e-9757-8ef52036316f tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc" status: 404 len: 111 microversion: 2.1 time: 0.028730 Apr 12 00:35:32.936727 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 513/1001] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:35:32 2022] GET /compute/v2.1/servers/29aa1426-1684-47b1-aded-1c9c306543bc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 00:35:33.090731 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-8add47c8-1c26-4c1f-807e-fb6a60e69993 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] Calling method '.version_select at 0x7f64e1d7b040>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:33.108832 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-8add47c8-1c26-4c1f-807e-fb6a60e69993 tempest-TestShelveInstance-77291564 tempest-TestShelveInstance-77291564-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-147522559" status: 202 len: 0 microversion: 2.1 time: 0.022690 Apr 12 00:35:33.109420 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 489/1002] 10.222.0.32 () {58 vars in 1250 bytes} [Tue Apr 12 00:35:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-147522559 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:35:37.283852 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ff5c009a-43c9-48fe-9b8a-349142d3d774 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:37.284451 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ff5c009a-43c9-48fe-9b8a-349142d3d774 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:37.290896 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ff5c009a-43c9-48fe-9b8a-349142d3d774 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:37.291345 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ff5c009a-43c9-48fe-9b8a-349142d3d774 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:37.292119 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ff5c009a-43c9-48fe-9b8a-349142d3d774 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:37.292546 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ff5c009a-43c9-48fe-9b8a-349142d3d774 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:37.317185 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ff5c009a-43c9-48fe-9b8a-349142d3d774 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/ips" status: 200 len: 146 microversion: 2.1 time: 0.037336 Apr 12 00:35:37.317765 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 514/1003] 10.222.0.32 () {58 vars in 1247 bytes} [Tue Apr 12 00:35:37 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:38.652035 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5ab17062-9c5f-41b0-a4e5-d7b5000affde tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a24a8fbf-1e33-45b1-92b5-f19e0996056d"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:38.653195 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5ab17062-9c5f-41b0-a4e5-d7b5000affde tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:38.661887 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5ab17062-9c5f-41b0-a4e5-d7b5000affde tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:38.662454 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5ab17062-9c5f-41b0-a4e5-d7b5000affde tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:38.663301 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5ab17062-9c5f-41b0-a4e5-d7b5000affde tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:38.663806 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5ab17062-9c5f-41b0-a4e5-d7b5000affde tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:38.948801 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5ab17062-9c5f-41b0-a4e5-d7b5000affde tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "POST /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300986 Apr 12 00:35:38.949808 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 490/1004] 10.222.0.32 () {60 vars in 1322 bytes} [Tue Apr 12 00:35:38 2022] POST /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:46.420115 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f7925626-8db8-4354-aa71-a8b902d9f3f6 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:46.421094 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f7925626-8db8-4354-aa71-a8b902d9f3f6 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:46.428007 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f7925626-8db8-4354-aa71-a8b902d9f3f6 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:46.428459 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f7925626-8db8-4354-aa71-a8b902d9f3f6 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:46.429239 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f7925626-8db8-4354-aa71-a8b902d9f3f6 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:46.429670 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f7925626-8db8-4354-aa71-a8b902d9f3f6 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:46.457223 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f7925626-8db8-4354-aa71-a8b902d9f3f6 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040958 Apr 12 00:35:46.457765 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 515/1005] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:35:46 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:46.468589 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-0f963d40-826b-4ced-9b0c-3f3ad8000d70 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:46.469671 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-0f963d40-826b-4ced-9b0c-3f3ad8000d70 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:46.475765 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0f963d40-826b-4ced-9b0c-3f3ad8000d70 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:46.476149 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0f963d40-826b-4ced-9b0c-3f3ad8000d70 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:46.476909 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0f963d40-826b-4ced-9b0c-3f3ad8000d70 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:46.477345 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0f963d40-826b-4ced-9b0c-3f3ad8000d70 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:46.504662 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-0f963d40-826b-4ced-9b0c-3f3ad8000d70 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments/a24a8fbf-1e33-45b1-92b5-f19e0996056d" status: 200 len: 194 microversion: 2.1 time: 0.040963 Apr 12 00:35:46.505224 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 491/1006] 10.222.0.32 () {58 vars in 1412 bytes} [Tue Apr 12 00:35:46 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments/a24a8fbf-1e33-45b1-92b5-f19e0996056d => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:35:47.802311 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7b072847-32d1-44cf-a084-126bfe09b051 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "369a8737-92c7-4e94-8eb4-9e45a6e865dc"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:47.803372 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7b072847-32d1-44cf-a084-126bfe09b051 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:47.809572 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b072847-32d1-44cf-a084-126bfe09b051 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:47.810022 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b072847-32d1-44cf-a084-126bfe09b051 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:47.810835 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b072847-32d1-44cf-a084-126bfe09b051 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:47.811263 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b072847-32d1-44cf-a084-126bfe09b051 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:48.256589 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7b072847-32d1-44cf-a084-126bfe09b051 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "POST /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.458087 Apr 12 00:35:48.257181 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 516/1007] 10.222.0.32 () {60 vars in 1322 bytes} [Tue Apr 12 00:35:47 2022] POST /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments => generated 194 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:49.796436 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:35:49.797833 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: Tue Apr 12 00:35:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 00:35:55.846313 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c57b8252-f0df-46f3-a1d3-d8a6da955521 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:55.847303 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c57b8252-f0df-46f3-a1d3-d8a6da955521 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:55.853558 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c57b8252-f0df-46f3-a1d3-d8a6da955521 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:55.854007 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c57b8252-f0df-46f3-a1d3-d8a6da955521 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:55.854810 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c57b8252-f0df-46f3-a1d3-d8a6da955521 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:55.855250 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c57b8252-f0df-46f3-a1d3-d8a6da955521 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:55.884148 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c57b8252-f0df-46f3-a1d3-d8a6da955521 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041778 Apr 12 00:35:55.884695 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 492/1008] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:35:55 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:56.036440 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b9495ea6-5035-4c20-8ce4-649268ba9134 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:56.036973 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b9495ea6-5035-4c20-8ce4-649268ba9134 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:56.043031 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9495ea6-5035-4c20-8ce4-649268ba9134 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:56.043484 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9495ea6-5035-4c20-8ce4-649268ba9134 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:56.044252 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9495ea6-5035-4c20-8ce4-649268ba9134 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:56.044688 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b9495ea6-5035-4c20-8ce4-649268ba9134 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:56.073101 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b9495ea6-5035-4c20-8ce4-649268ba9134 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments/a24a8fbf-1e33-45b1-92b5-f19e0996056d" status: 200 len: 194 microversion: 2.1 time: 0.041541 Apr 12 00:35:56.073668 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 517/1009] 10.222.0.32 () {58 vars in 1412 bytes} [Tue Apr 12 00:35:56 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments/a24a8fbf-1e33-45b1-92b5-f19e0996056d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:56.083197 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-38de481f-4cf3-426c-928a-ec58fb52bd32 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:56.083694 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-38de481f-4cf3-426c-928a-ec58fb52bd32 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:56.089478 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-38de481f-4cf3-426c-928a-ec58fb52bd32 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:56.089929 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-38de481f-4cf3-426c-928a-ec58fb52bd32 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:56.090713 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-38de481f-4cf3-426c-928a-ec58fb52bd32 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:56.091149 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-38de481f-4cf3-426c-928a-ec58fb52bd32 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:56.221488 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-38de481f-4cf3-426c-928a-ec58fb52bd32 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lazy-loading 'services' on Instance uuid d9b5894e-894a-440c-b868-3df0c388fda0 {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:35:56.288845 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-38de481f-4cf3-426c-928a-ec58fb52bd32 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments/a24a8fbf-1e33-45b1-92b5-f19e0996056d" status: 202 len: 0 microversion: 2.1 time: 0.209358 Apr 12 00:35:56.289368 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 493/1010] 10.222.0.32 () {58 vars in 1415 bytes} [Tue Apr 12 00:35:56 2022] DELETE /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments/a24a8fbf-1e33-45b1-92b5-f19e0996056d => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:35:58.445954 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-da2c5b27-c2f8-4671-946d-5554f34b385a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:58.446533 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-da2c5b27-c2f8-4671-946d-5554f34b385a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:58.452710 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-da2c5b27-c2f8-4671-946d-5554f34b385a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:58.453159 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-da2c5b27-c2f8-4671-946d-5554f34b385a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:58.453925 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-da2c5b27-c2f8-4671-946d-5554f34b385a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:58.454382 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-da2c5b27-c2f8-4671-946d-5554f34b385a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:58.481432 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-da2c5b27-c2f8-4671-946d-5554f34b385a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments/369a8737-92c7-4e94-8eb4-9e45a6e865dc" status: 200 len: 194 microversion: 2.1 time: 0.039459 Apr 12 00:35:58.482008 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 518/1011] 10.222.0.32 () {58 vars in 1412 bytes} [Tue Apr 12 00:35:58 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments/369a8737-92c7-4e94-8eb4-9e45a6e865dc => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:58.493258 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1a975d7d-6201-4b5e-adde-4b90ebb3044a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:58.493840 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1a975d7d-6201-4b5e-adde-4b90ebb3044a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:58.499837 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1a975d7d-6201-4b5e-adde-4b90ebb3044a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:58.500290 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1a975d7d-6201-4b5e-adde-4b90ebb3044a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:58.501054 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1a975d7d-6201-4b5e-adde-4b90ebb3044a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:58.501492 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1a975d7d-6201-4b5e-adde-4b90ebb3044a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:58.579417 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-1a975d7d-6201-4b5e-adde-4b90ebb3044a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lazy-loading 'services' on Instance uuid d9b5894e-894a-440c-b868-3df0c388fda0 {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:35:58.650873 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1a975d7d-6201-4b5e-adde-4b90ebb3044a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments/369a8737-92c7-4e94-8eb4-9e45a6e865dc" status: 202 len: 0 microversion: 2.1 time: 0.161855 Apr 12 00:35:58.651606 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 494/1012] 10.222.0.32 () {58 vars in 1415 bytes} [Tue Apr 12 00:35:58 2022] DELETE /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments/369a8737-92c7-4e94-8eb4-9e45a6e865dc => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:35:59.988500 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a54b6fde-0a3f-4eac-8d26-3d2e3819e80b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:59.989419 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a54b6fde-0a3f-4eac-8d26-3d2e3819e80b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:35:59.995708 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a54b6fde-0a3f-4eac-8d26-3d2e3819e80b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:59.996155 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a54b6fde-0a3f-4eac-8d26-3d2e3819e80b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:35:59.996941 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a54b6fde-0a3f-4eac-8d26-3d2e3819e80b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:35:59.997393 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a54b6fde-0a3f-4eac-8d26-3d2e3819e80b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:00.025504 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a54b6fde-0a3f-4eac-8d26-3d2e3819e80b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041027 Apr 12 00:36:00.026052 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 519/1013] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:35:59 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:36:00.127666 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-dfa01335-ffbb-4c51-912c-db55f0e22c6a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:00.128678 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-dfa01335-ffbb-4c51-912c-db55f0e22c6a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:00.135102 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dfa01335-ffbb-4c51-912c-db55f0e22c6a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:00.135555 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dfa01335-ffbb-4c51-912c-db55f0e22c6a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:00.136319 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dfa01335-ffbb-4c51-912c-db55f0e22c6a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:00.136759 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dfa01335-ffbb-4c51-912c-db55f0e22c6a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:00.165662 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-dfa01335-ffbb-4c51-912c-db55f0e22c6a tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042876 Apr 12 00:36:00.166207 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 495/1014] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:36:00 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:36:00.222364 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-baf177e3-cf97-45cb-a472-41a9fd157ba5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:00.222957 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-baf177e3-cf97-45cb-a472-41a9fd157ba5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:00.228696 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-baf177e3-cf97-45cb-a472-41a9fd157ba5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:00.229142 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-baf177e3-cf97-45cb-a472-41a9fd157ba5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:00.229891 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-baf177e3-cf97-45cb-a472-41a9fd157ba5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:00.230381 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-baf177e3-cf97-45cb-a472-41a9fd157ba5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:00.253598 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-baf177e3-cf97-45cb-a472-41a9fd157ba5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Going to try to terminate instance {{(pid=128486) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:36:00.326487 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-baf177e3-cf97-45cb-a472-41a9fd157ba5 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 204 len: 0 microversion: 2.1 time: 0.107583 Apr 12 00:36:00.327304 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 520/1015] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:36:00 2022] DELETE /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:36:00.335551 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5e51f5d5-8625-4c08-a4fe-f4190483eea4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:00.336166 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5e51f5d5-8625-4c08-a4fe-f4190483eea4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:00.341928 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5e51f5d5-8625-4c08-a4fe-f4190483eea4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:00.342415 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5e51f5d5-8625-4c08-a4fe-f4190483eea4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:00.343179 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5e51f5d5-8625-4c08-a4fe-f4190483eea4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:00.343637 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5e51f5d5-8625-4c08-a4fe-f4190483eea4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:00.468714 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-5e51f5d5-8625-4c08-a4fe-f4190483eea4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:00.476020 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5e51f5d5-8625-4c08-a4fe-f4190483eea4 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1674 microversion: 2.1 time: 0.144258 Apr 12 00:36:00.476607 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 496/1016] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:00 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1674 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:01.493798 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-82e08282-1093-46b5-8b05-ccb87dbdc26b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:01.494634 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-82e08282-1093-46b5-8b05-ccb87dbdc26b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:01.501230 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-82e08282-1093-46b5-8b05-ccb87dbdc26b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:01.501676 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-82e08282-1093-46b5-8b05-ccb87dbdc26b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:01.502466 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-82e08282-1093-46b5-8b05-ccb87dbdc26b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:01.502903 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-82e08282-1093-46b5-8b05-ccb87dbdc26b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:01.631768 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-82e08282-1093-46b5-8b05-ccb87dbdc26b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:01.638991 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-82e08282-1093-46b5-8b05-ccb87dbdc26b tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1674 microversion: 2.1 time: 0.149408 Apr 12 00:36:01.639557 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 521/1017] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:01 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:02.655905 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3e753778-51cb-4830-915b-4b349d89fcae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:02.657201 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3e753778-51cb-4830-915b-4b349d89fcae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:02.663491 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3e753778-51cb-4830-915b-4b349d89fcae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:02.663934 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3e753778-51cb-4830-915b-4b349d89fcae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:02.664711 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3e753778-51cb-4830-915b-4b349d89fcae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:02.665149 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3e753778-51cb-4830-915b-4b349d89fcae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:02.893606 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-3e753778-51cb-4830-915b-4b349d89fcae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:02.900880 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3e753778-51cb-4830-915b-4b349d89fcae tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1674 microversion: 2.1 time: 0.248846 Apr 12 00:36:02.901456 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 497/1018] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:02 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1674 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:03.525718 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-731fb68c-6526-4645-bba9-0e1ed32f455b req-ab60923c-d042-4998-aeb6-b233a31e32cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b5894e-894a-440c-b868-3df0c388fda0", "name": "network-vif-deleted", "tag": "4c6b1ac0-8e24-4c16-a4d3-c8ccd6876629"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:03.536769 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-731fb68c-6526-4645-bba9-0e1ed32f455b req-ab60923c-d042-4998-aeb6-b233a31e32cd service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:03.537210 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-731fb68c-6526-4645-bba9-0e1ed32f455b req-ab60923c-d042-4998-aeb6-b233a31e32cd service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:03.548347 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-731fb68c-6526-4645-bba9-0e1ed32f455b req-ab60923c-d042-4998-aeb6-b233a31e32cd service nova] Creating event network-vif-deleted:4c6b1ac0-8e24-4c16-a4d3-c8ccd6876629 for instance d9b5894e-894a-440c-b868-3df0c388fda0 on hv-cinder-83625 Apr 12 00:36:03.553458 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-731fb68c-6526-4645-bba9-0e1ed32f455b req-ab60923c-d042-4998-aeb6-b233a31e32cd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034537 Apr 12 00:36:03.554324 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 522/1019] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:03.916928 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-86a0742a-29c1-41d6-b120-6587978204bb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:03.918282 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-86a0742a-29c1-41d6-b120-6587978204bb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:03.925972 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-86a0742a-29c1-41d6-b120-6587978204bb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:03.926459 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-86a0742a-29c1-41d6-b120-6587978204bb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:03.927233 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-86a0742a-29c1-41d6-b120-6587978204bb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:03.927665 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-86a0742a-29c1-41d6-b120-6587978204bb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:03.957659 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-86a0742a-29c1-41d6-b120-6587978204bb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:03.958409 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-86a0742a-29c1-41d6-b120-6587978204bb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:03.958740 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-86a0742a-29c1-41d6-b120-6587978204bb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lazy-loading 'fault' on Instance uuid d9b5894e-894a-440c-b868-3df0c388fda0 {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:36:04.003673 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-86a0742a-29c1-41d6-b120-6587978204bb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548e01902ba41e79667ed56d602f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08909d19c8341c5b47846b0cee54fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:04.011436 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-86a0742a-29c1-41d6-b120-6587978204bb tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 200 len: 1327 microversion: 2.1 time: 0.098334 Apr 12 00:36:04.012336 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 498/1020] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:03 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:05.029847 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-947a4386-eef4-431e-89dc-fc62ab0f8b55 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:05.030599 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-947a4386-eef4-431e-89dc-fc62ab0f8b55 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:05.036748 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-947a4386-eef4-431e-89dc-fc62ab0f8b55 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:05.037194 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-947a4386-eef4-431e-89dc-fc62ab0f8b55 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:05.037955 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-947a4386-eef4-431e-89dc-fc62ab0f8b55 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:05.038424 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-947a4386-eef4-431e-89dc-fc62ab0f8b55 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:05.051615 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-947a4386-eef4-431e-89dc-fc62ab0f8b55 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] HTTP exception thrown: Instance d9b5894e-894a-440c-b868-3df0c388fda0 could not be found. Apr 12 00:36:05.052183 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-947a4386-eef4-431e-89dc-fc62ab0f8b55 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Returning 404 to user: Instance d9b5894e-894a-440c-b868-3df0c388fda0 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:36:05.052972 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-947a4386-eef4-431e-89dc-fc62ab0f8b55 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 404 len: 111 microversion: 2.1 time: 0.027814 Apr 12 00:36:05.053485 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 523/1021] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:05 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:36:05.061586 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-96296b2b-b01d-4f0d-9673-759bfe81b1de tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '.version_select at 0x7f64e1157ee0>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:05.078950 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-96296b2b-b01d-4f0d-9673-759bfe81b1de tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458530577" status: 202 len: 0 microversion: 2.1 time: 0.021144 Apr 12 00:36:05.079498 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 499/1022] 10.222.0.32 () {58 vars in 1220 bytes} [Tue Apr 12 00:36:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458530577 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:36:07.917631 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-19bb6597-1afa-4690-933d-e5fae55d6927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:07.918114 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-19bb6597-1afa-4690-933d-e5fae55d6927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:07.924403 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-19bb6597-1afa-4690-933d-e5fae55d6927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:07.924854 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-19bb6597-1afa-4690-933d-e5fae55d6927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:07.925616 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-19bb6597-1afa-4690-933d-e5fae55d6927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:07.926053 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-19bb6597-1afa-4690-933d-e5fae55d6927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:07.939462 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-19bb6597-1afa-4690-933d-e5fae55d6927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] HTTP exception thrown: Instance d9b5894e-894a-440c-b868-3df0c388fda0 could not be found. Apr 12 00:36:07.940038 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-19bb6597-1afa-4690-933d-e5fae55d6927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Returning 404 to user: Instance d9b5894e-894a-440c-b868-3df0c388fda0 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:36:07.940837 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-19bb6597-1afa-4690-933d-e5fae55d6927 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 404 len: 111 microversion: 2.1 time: 0.027053 Apr 12 00:36:07.941357 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 524/1023] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:36:07 2022] DELETE /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:36:07.949568 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-00f57aaa-be7b-4b8a-8c01-3af4d5ca31e1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:07.950185 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-00f57aaa-be7b-4b8a-8c01-3af4d5ca31e1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: d9b5894e-894a-440c-b868-3df0c388fda0] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:07.957078 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-00f57aaa-be7b-4b8a-8c01-3af4d5ca31e1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:07.957529 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-00f57aaa-be7b-4b8a-8c01-3af4d5ca31e1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:07.958312 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-00f57aaa-be7b-4b8a-8c01-3af4d5ca31e1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:07.958761 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-00f57aaa-be7b-4b8a-8c01-3af4d5ca31e1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:07.971872 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-00f57aaa-be7b-4b8a-8c01-3af4d5ca31e1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] HTTP exception thrown: Instance d9b5894e-894a-440c-b868-3df0c388fda0 could not be found. Apr 12 00:36:07.972447 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-00f57aaa-be7b-4b8a-8c01-3af4d5ca31e1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Returning 404 to user: Instance d9b5894e-894a-440c-b868-3df0c388fda0 could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:36:07.973269 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-00f57aaa-be7b-4b8a-8c01-3af4d5ca31e1 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0" status: 404 len: 111 microversion: 2.1 time: 0.028017 Apr 12 00:36:07.973787 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 500/1024] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:07 2022] GET /compute/v2.1/servers/d9b5894e-894a-440c-b868-3df0c388fda0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:36:09.098577 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3949ddff-5870-481d-902e-efd7af27c6a8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:09.099095 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3949ddff-5870-481d-902e-efd7af27c6a8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:09.105292 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3949ddff-5870-481d-902e-efd7af27c6a8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:09.105737 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3949ddff-5870-481d-902e-efd7af27c6a8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:09.106525 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3949ddff-5870-481d-902e-efd7af27c6a8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:09.106957 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3949ddff-5870-481d-902e-efd7af27c6a8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:09.119832 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-3949ddff-5870-481d-902e-efd7af27c6a8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] HTTP exception thrown: Instance 6812d1c1-9663-404e-a23f-db9a8dc7e766 could not be found. Apr 12 00:36:09.120398 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3949ddff-5870-481d-902e-efd7af27c6a8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Returning 404 to user: Instance 6812d1c1-9663-404e-a23f-db9a8dc7e766 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:36:09.121189 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3949ddff-5870-481d-902e-efd7af27c6a8 tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 404 len: 111 microversion: 2.1 time: 0.026470 Apr 12 00:36:09.121697 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 525/1025] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:36:09 2022] DELETE /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:36:09.129763 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-239f5822-e04f-40dc-909d-fa88c81be8fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:09.130400 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-239f5822-e04f-40dc-909d-fa88c81be8fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] [instance: 6812d1c1-9663-404e-a23f-db9a8dc7e766] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:09.136348 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-239f5822-e04f-40dc-909d-fa88c81be8fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:09.136792 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-239f5822-e04f-40dc-909d-fa88c81be8fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:09.137547 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-239f5822-e04f-40dc-909d-fa88c81be8fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:09.137978 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-239f5822-e04f-40dc-909d-fa88c81be8fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:09.151393 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-239f5822-e04f-40dc-909d-fa88c81be8fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] HTTP exception thrown: Instance 6812d1c1-9663-404e-a23f-db9a8dc7e766 could not be found. Apr 12 00:36:09.151956 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-239f5822-e04f-40dc-909d-fa88c81be8fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] Returning 404 to user: Instance 6812d1c1-9663-404e-a23f-db9a8dc7e766 could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:36:09.152750 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-239f5822-e04f-40dc-909d-fa88c81be8fe tempest-AttachVolumeTestJSON-1281135730 tempest-AttachVolumeTestJSON-1281135730-project] 10.222.0.32 "GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766" status: 404 len: 111 microversion: 2.1 time: 0.026704 Apr 12 00:36:09.153291 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 501/1026] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:09 2022] GET /compute/v2.1/servers/6812d1c1-9663-404e-a23f-db9a8dc7e766 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:36:22.181943 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1ce1b2a2-dd1e-4e8a-bfaa-0af20953fab3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:22.182899 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1ce1b2a2-dd1e-4e8a-bfaa-0af20953fab3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:22.189772 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1ce1b2a2-dd1e-4e8a-bfaa-0af20953fab3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:22.190221 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1ce1b2a2-dd1e-4e8a-bfaa-0af20953fab3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:22.191007 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1ce1b2a2-dd1e-4e8a-bfaa-0af20953fab3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:22.191499 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1ce1b2a2-dd1e-4e8a-bfaa-0af20953fab3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:22.220001 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1ce1b2a2-dd1e-4e8a-bfaa-0af20953fab3 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041950 Apr 12 00:36:22.220495 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 526/1027] 10.222.0.32 () {60 vars in 1342 bytes} [Tue Apr 12 00:36:22 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:22.274932 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-54c8f993-0daf-4f48-a978-c55a98673171 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:22.275428 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-54c8f993-0daf-4f48-a978-c55a98673171 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:22.282202 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-54c8f993-0daf-4f48-a978-c55a98673171 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:22.282686 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-54c8f993-0daf-4f48-a978-c55a98673171 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:22.283443 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-54c8f993-0daf-4f48-a978-c55a98673171 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:22.283876 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-54c8f993-0daf-4f48-a978-c55a98673171 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:22.308061 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-54c8f993-0daf-4f48-a978-c55a98673171 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Going to try to terminate instance {{(pid=128487) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:36:22.383206 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-54c8f993-0daf-4f48-a978-c55a98673171 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 204 len: 0 microversion: 2.20 time: 0.111778 Apr 12 00:36:22.383854 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 502/1028] 10.222.0.32 () {60 vars in 1279 bytes} [Tue Apr 12 00:36:22 2022] DELETE /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 00:36:22.392147 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-186ef2b3-94dd-49e6-bc85-fddd0ff0c7d2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:22.392753 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-186ef2b3-94dd-49e6-bc85-fddd0ff0c7d2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:22.398519 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-186ef2b3-94dd-49e6-bc85-fddd0ff0c7d2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:22.398966 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-186ef2b3-94dd-49e6-bc85-fddd0ff0c7d2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:22.399716 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-186ef2b3-94dd-49e6-bc85-fddd0ff0c7d2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:22.400147 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-186ef2b3-94dd-49e6-bc85-fddd0ff0c7d2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:22.529227 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-186ef2b3-94dd-49e6-bc85-fddd0ff0c7d2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:22.537043 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-186ef2b3-94dd-49e6-bc85-fddd0ff0c7d2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:22.538572 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-186ef2b3-94dd-49e6-bc85-fddd0ff0c7d2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:22.539720 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-186ef2b3-94dd-49e6-bc85-fddd0ff0c7d2 tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.151715 Apr 12 00:36:22.540279 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 527/1029] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:36:22 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:36:23.557447 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-415d6841-1f47-4a0f-a775-940ad5028d2f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:23.558150 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-415d6841-1f47-4a0f-a775-940ad5028d2f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:23.565020 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-415d6841-1f47-4a0f-a775-940ad5028d2f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:23.565472 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-415d6841-1f47-4a0f-a775-940ad5028d2f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:23.566239 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-415d6841-1f47-4a0f-a775-940ad5028d2f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:23.566712 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-415d6841-1f47-4a0f-a775-940ad5028d2f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:23.699366 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-415d6841-1f47-4a0f-a775-940ad5028d2f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:23.707595 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-415d6841-1f47-4a0f-a775-940ad5028d2f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:23.709358 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-415d6841-1f47-4a0f-a775-940ad5028d2f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:23.710570 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-415d6841-1f47-4a0f-a775-940ad5028d2f tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1724 microversion: 2.20 time: 0.157421 Apr 12 00:36:23.711138 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 503/1030] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:36:23 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:36:24.728934 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-97daed3c-0015-4641-83ce-1247f159a8dc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:24.729592 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-97daed3c-0015-4641-83ce-1247f159a8dc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:24.736571 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-97daed3c-0015-4641-83ce-1247f159a8dc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:24.737052 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-97daed3c-0015-4641-83ce-1247f159a8dc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:24.737826 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-97daed3c-0015-4641-83ce-1247f159a8dc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:24.738279 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-97daed3c-0015-4641-83ce-1247f159a8dc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:24.799938 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-97daed3c-0015-4641-83ce-1247f159a8dc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:24.818623 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-97daed3c-0015-4641-83ce-1247f159a8dc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:24.820124 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-97daed3c-0015-4641-83ce-1247f159a8dc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0fad81c4cbd4335967e97fd7de9963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:24.821284 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-97daed3c-0015-4641-83ce-1247f159a8dc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 200 len: 1656 microversion: 2.20 time: 0.096311 Apr 12 00:36:24.822036 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 528/1031] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:36:24 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 1656 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:36:24.855524 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-2d635728-ca4a-4b65-b61a-40d7c04aff4e req-fd817653-44f7-4903-ae87-d5bb089c1f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd000ee-5205-4d02-b7a8-8c99871c8f29", "name": "network-vif-deleted", "tag": "0e9155b9-7112-41cd-b8ec-dd359b342b3a"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:24.864911 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-2d635728-ca4a-4b65-b61a-40d7c04aff4e req-fd817653-44f7-4903-ae87-d5bb089c1f8f service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:24.865358 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-2d635728-ca4a-4b65-b61a-40d7c04aff4e req-fd817653-44f7-4903-ae87-d5bb089c1f8f service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:24.876598 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-2d635728-ca4a-4b65-b61a-40d7c04aff4e req-fd817653-44f7-4903-ae87-d5bb089c1f8f service nova] Creating event network-vif-deleted:0e9155b9-7112-41cd-b8ec-dd359b342b3a for instance 6fd000ee-5205-4d02-b7a8-8c99871c8f29 on hv-cinder-83625 Apr 12 00:36:24.882293 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-2d635728-ca4a-4b65-b61a-40d7c04aff4e req-fd817653-44f7-4903-ae87-d5bb089c1f8f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030504 Apr 12 00:36:24.882939 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 504/1032] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:25.839398 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-bcc07bbe-9be7-4a2e-b6ef-9cbc3019365b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:25.840036 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-bcc07bbe-9be7-4a2e-b6ef-9cbc3019365b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:25.846965 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bcc07bbe-9be7-4a2e-b6ef-9cbc3019365b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:25.847406 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bcc07bbe-9be7-4a2e-b6ef-9cbc3019365b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:25.848164 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bcc07bbe-9be7-4a2e-b6ef-9cbc3019365b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:25.848597 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bcc07bbe-9be7-4a2e-b6ef-9cbc3019365b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:25.861580 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-bcc07bbe-9be7-4a2e-b6ef-9cbc3019365b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] HTTP exception thrown: Instance 6fd000ee-5205-4d02-b7a8-8c99871c8f29 could not be found. Apr 12 00:36:25.862304 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-bcc07bbe-9be7-4a2e-b6ef-9cbc3019365b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Returning 404 to user: Instance 6fd000ee-5205-4d02-b7a8-8c99871c8f29 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:36:25.863110 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-bcc07bbe-9be7-4a2e-b6ef-9cbc3019365b tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 404 len: 111 microversion: 2.20 time: 0.027611 Apr 12 00:36:25.863634 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 529/1033] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:36:25 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:36:25.872918 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4121deba-341f-405a-a4b9-a810ebab3dfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '.version_select at 0x7f64e1498550>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:25.889094 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-4121deba-341f-405a-a4b9-a810ebab3dfe tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1976025183" status: 204 len: 0 microversion: 2.20 time: 0.020856 Apr 12 00:36:25.889656 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 505/1034] 10.222.0.32 () {60 vars in 1261 bytes} [Tue Apr 12 00:36:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1976025183 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 12 00:36:27.621944 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9908f964-10be-40f9-914a-4e4209225adc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:27.622543 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9908f964-10be-40f9-914a-4e4209225adc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:27.629369 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9908f964-10be-40f9-914a-4e4209225adc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:27.629825 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9908f964-10be-40f9-914a-4e4209225adc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:27.630615 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9908f964-10be-40f9-914a-4e4209225adc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:27.631054 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9908f964-10be-40f9-914a-4e4209225adc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:27.644576 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-9908f964-10be-40f9-914a-4e4209225adc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] HTTP exception thrown: Instance 6fd000ee-5205-4d02-b7a8-8c99871c8f29 could not be found. Apr 12 00:36:27.645158 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9908f964-10be-40f9-914a-4e4209225adc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Returning 404 to user: Instance 6fd000ee-5205-4d02-b7a8-8c99871c8f29 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:36:27.645967 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9908f964-10be-40f9-914a-4e4209225adc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 404 len: 111 microversion: 2.20 time: 0.027892 Apr 12 00:36:27.646515 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 530/1035] 10.222.0.32 () {60 vars in 1279 bytes} [Tue Apr 12 00:36:27 2022] DELETE /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:36:27.654872 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-cd5da571-e889-40ec-99c6-7ca6b60812fa tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:27.655606 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-cd5da571-e889-40ec-99c6-7ca6b60812fa tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 6fd000ee-5205-4d02-b7a8-8c99871c8f29] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:27.662816 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cd5da571-e889-40ec-99c6-7ca6b60812fa tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:27.663268 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cd5da571-e889-40ec-99c6-7ca6b60812fa tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:27.664030 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cd5da571-e889-40ec-99c6-7ca6b60812fa tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:27.664464 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cd5da571-e889-40ec-99c6-7ca6b60812fa tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:27.677984 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-cd5da571-e889-40ec-99c6-7ca6b60812fa tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] HTTP exception thrown: Instance 6fd000ee-5205-4d02-b7a8-8c99871c8f29 could not be found. Apr 12 00:36:27.678578 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-cd5da571-e889-40ec-99c6-7ca6b60812fa tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Returning 404 to user: Instance 6fd000ee-5205-4d02-b7a8-8c99871c8f29 could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:36:27.679428 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-cd5da571-e889-40ec-99c6-7ca6b60812fa tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29" status: 404 len: 111 microversion: 2.20 time: 0.029012 Apr 12 00:36:27.679964 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 506/1036] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:36:27 2022] GET /compute/v2.1/servers/6fd000ee-5205-4d02-b7a8-8c99871c8f29 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:36:32.994281 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-89ece07f-f1f7-4663-be22-c5ebae544e2a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:32.994820 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-89ece07f-f1f7-4663-be22-c5ebae544e2a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:33.001119 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-89ece07f-f1f7-4663-be22-c5ebae544e2a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:33.001570 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-89ece07f-f1f7-4663-be22-c5ebae544e2a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:33.002390 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-89ece07f-f1f7-4663-be22-c5ebae544e2a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:33.002835 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-89ece07f-f1f7-4663-be22-c5ebae544e2a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:33.016881 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-89ece07f-f1f7-4663-be22-c5ebae544e2a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] HTTP exception thrown: Instance 02c4e615-6c86-41a2-b6a5-19371b76e311 could not be found. Apr 12 00:36:33.017461 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-89ece07f-f1f7-4663-be22-c5ebae544e2a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Returning 404 to user: Instance 02c4e615-6c86-41a2-b6a5-19371b76e311 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:36:33.018315 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-89ece07f-f1f7-4663-be22-c5ebae544e2a tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "DELETE /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 404 len: 111 microversion: 2.20 time: 0.028357 Apr 12 00:36:33.018849 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 531/1037] 10.222.0.32 () {60 vars in 1279 bytes} [Tue Apr 12 00:36:32 2022] DELETE /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:36:33.026771 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4a2f3f97-33ae-479c-bf26-9cefdccab7fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:33.027388 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-4a2f3f97-33ae-479c-bf26-9cefdccab7fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] [instance: 02c4e615-6c86-41a2-b6a5-19371b76e311] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:33.033479 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4a2f3f97-33ae-479c-bf26-9cefdccab7fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:33.033927 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4a2f3f97-33ae-479c-bf26-9cefdccab7fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:33.034712 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4a2f3f97-33ae-479c-bf26-9cefdccab7fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:33.035149 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4a2f3f97-33ae-479c-bf26-9cefdccab7fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:33.047886 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-4a2f3f97-33ae-479c-bf26-9cefdccab7fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] HTTP exception thrown: Instance 02c4e615-6c86-41a2-b6a5-19371b76e311 could not be found. Apr 12 00:36:33.048457 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4a2f3f97-33ae-479c-bf26-9cefdccab7fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] Returning 404 to user: Instance 02c4e615-6c86-41a2-b6a5-19371b76e311 could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:36:33.049255 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-4a2f3f97-33ae-479c-bf26-9cefdccab7fc tempest-AttachVolumeShelveTestJSON-1413489074 tempest-AttachVolumeShelveTestJSON-1413489074-project] 10.222.0.32 "GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311" status: 404 len: 111 microversion: 2.20 time: 0.026369 Apr 12 00:36:33.049770 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 507/1038] 10.222.0.32 () {60 vars in 1276 bytes} [Tue Apr 12 00:36:33 2022] GET /compute/v2.1/servers/02c4e615-6c86-41a2-b6a5-19371b76e311 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:36:37.261280 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-30d6ed04-fde7-4b8e-b2dc-3060901c9048 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-948562183", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-989695835", "security_groups": [{"name": "tempest-secgroup-smoke-1352959982"}], "block_device_mapping_v2": [{"uuid": "20426d25-4ca5-4125-a796-1ddb118b6f71", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8a9865c2-0d03-40f9-a71a-607e87040674"}]}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:37.377977 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.network.neutron [None req-30d6ed04-fde7-4b8e-b2dc-3060901c9048 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] validate_networks() for [('8a9865c2-0d03-40f9-a71a-607e87040674', None, None, None, None, None)] {{(pid=128486) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:36:37.802528 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-30d6ed04-fde7-4b8e-b2dc-3060901c9048 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Flavor limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:36:37.802942 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-30d6ed04-fde7-4b8e-b2dc-3060901c9048 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Image limits 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:36:37.803407 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-30d6ed04-fde7-4b8e-b2dc-3060901c9048 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Flavor pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:36:37.803838 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-30d6ed04-fde7-4b8e-b2dc-3060901c9048 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Image pref 0:0:0 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:36:37.804270 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.virt.hardware [None req-30d6ed04-fde7-4b8e-b2dc-3060901c9048 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:36:37.813444 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-30d6ed04-fde7-4b8e-b2dc-3060901c9048 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:37.814326 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-30d6ed04-fde7-4b8e-b2dc-3060901c9048 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:37.815246 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-30d6ed04-fde7-4b8e-b2dc-3060901c9048 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:37.815677 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-30d6ed04-fde7-4b8e-b2dc-3060901c9048 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:37.833671 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-30d6ed04-fde7-4b8e-b2dc-3060901c9048 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Getting quotas for project 4ad54dac63374c8a9b4da55ee5dc7fd1. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:36:37.837927 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-30d6ed04-fde7-4b8e-b2dc-3060901c9048 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Getting quotas for user 3b1d212dad5347a888832a779beadece and project 4ad54dac63374c8a9b4da55ee5dc7fd1. Resources: {'cores', 'instances', 'ram'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:36:37.902218 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-30d6ed04-fde7-4b8e-b2dc-3060901c9048 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Going to run 1 instances... {{(pid=128486) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:36:37.911871 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-30d6ed04-fde7-4b8e-b2dc-3060901c9048 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20426d25-4ca5-4125-a796-1ddb118b6f71',volume_size=None,volume_type=None)] {{(pid=128486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:36:38.054889 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-30d6ed04-fde7-4b8e-b2dc-3060901c9048 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.797619 Apr 12 00:36:38.055784 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 532/1039] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:36:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:36:38.067612 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-02527c7b-2d1c-4a76-8c91-25ffb61a6ec2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:38.068444 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-02527c7b-2d1c-4a76-8c91-25ffb61a6ec2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:38.139934 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-02527c7b-2d1c-4a76-8c91-25ffb61a6ec2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:38.149826 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-02527c7b-2d1c-4a76-8c91-25ffb61a6ec2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1093 microversion: 2.1 time: 0.086682 Apr 12 00:36:38.165481 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 508/1040] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:38 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1093 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:39.167974 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f72438b3-c833-4713-b3a0-35ad48efe498 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:39.168757 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f72438b3-c833-4713-b3a0-35ad48efe498 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:39.185491 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f72438b3-c833-4713-b3a0-35ad48efe498 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:39.186484 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f72438b3-c833-4713-b3a0-35ad48efe498 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:39.188076 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f72438b3-c833-4713-b3a0-35ad48efe498 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:39.188796 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f72438b3-c833-4713-b3a0-35ad48efe498 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:39.326969 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f72438b3-c833-4713-b3a0-35ad48efe498 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:39.345668 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f72438b3-c833-4713-b3a0-35ad48efe498 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1199 microversion: 2.1 time: 0.181714 Apr 12 00:36:39.351648 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 533/1041] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:39 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1199 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:40.372314 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-fab2915b-e222-494a-8619-355d020415b3 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:40.372314 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-fab2915b-e222-494a-8619-355d020415b3 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:40.382574 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fab2915b-e222-494a-8619-355d020415b3 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:40.382921 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fab2915b-e222-494a-8619-355d020415b3 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:40.384079 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fab2915b-e222-494a-8619-355d020415b3 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:40.384776 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fab2915b-e222-494a-8619-355d020415b3 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:40.717841 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-fab2915b-e222-494a-8619-355d020415b3 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:40.726913 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-fab2915b-e222-494a-8619-355d020415b3 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1265 microversion: 2.1 time: 0.360610 Apr 12 00:36:40.739698 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 509/1042] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:40 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1265 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:41.320124 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-d76ed25b-742d-4b5e-8feb-378f91abdce8 req-b50c1bc1-720a-47c5-ae5e-b27273a754a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f92fc1-03bb-4d20-959e-fb9cd283f51a", "tag": "6de8e31e-e087-40aa-a319-0647d34795ca"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:41.332719 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-d76ed25b-742d-4b5e-8feb-378f91abdce8 req-b50c1bc1-720a-47c5-ae5e-b27273a754a1 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:41.334459 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-d76ed25b-742d-4b5e-8feb-378f91abdce8 req-b50c1bc1-720a-47c5-ae5e-b27273a754a1 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:41.367355 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-d76ed25b-742d-4b5e-8feb-378f91abdce8 req-b50c1bc1-720a-47c5-ae5e-b27273a754a1 service nova] Creating event network-changed:6de8e31e-e087-40aa-a319-0647d34795ca for instance b7f92fc1-03bb-4d20-959e-fb9cd283f51a on hv-cinder-83625 Apr 12 00:36:41.379078 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-d76ed25b-742d-4b5e-8feb-378f91abdce8 req-b50c1bc1-720a-47c5-ae5e-b27273a754a1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062124 Apr 12 00:36:41.380175 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 534/1043] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:41.745059 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-67ccf2ad-dfe1-45b2-bbcc-676ba60c78ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:41.745666 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-67ccf2ad-dfe1-45b2-bbcc-676ba60c78ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:41.758992 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-67ccf2ad-dfe1-45b2-bbcc-676ba60c78ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:41.759702 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-67ccf2ad-dfe1-45b2-bbcc-676ba60c78ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:41.760721 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-67ccf2ad-dfe1-45b2-bbcc-676ba60c78ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:41.761362 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-67ccf2ad-dfe1-45b2-bbcc-676ba60c78ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:42.037423 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-67ccf2ad-dfe1-45b2-bbcc-676ba60c78ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:42.046805 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-67ccf2ad-dfe1-45b2-bbcc-676ba60c78ac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1265 microversion: 2.1 time: 0.305877 Apr 12 00:36:42.048016 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 510/1044] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:41 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1265 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:42.891994 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b2e43925-b1a0-4d0b-9f0c-bb240c26c862 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Action: 'create', calling method: .version_select at 0x7f64e1457dc0>, body: {"keypair": {"name": "tempest-keypair-1831034167"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:42.906912 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-b2e43925-b1a0-4d0b-9f0c-bb240c26c862 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:36:42.910826 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-b2e43925-b1a0-4d0b-9f0c-bb240c26c862 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for user 69f5eaf4727f4bbf84ce10a5e07d582e and project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:36:43.063965 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-819f0ba3-28de-4fa5-9955-7b30e96a7862 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:43.064572 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-819f0ba3-28de-4fa5-9955-7b30e96a7862 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:43.070960 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-819f0ba3-28de-4fa5-9955-7b30e96a7862 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:43.071402 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-819f0ba3-28de-4fa5-9955-7b30e96a7862 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:43.072151 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-819f0ba3-28de-4fa5-9955-7b30e96a7862 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:43.072582 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-819f0ba3-28de-4fa5-9955-7b30e96a7862 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:43.132866 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-b2e43925-b1a0-4d0b-9f0c-bb240c26c862 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:36:43.136973 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-b2e43925-b1a0-4d0b-9f0c-bb240c26c862 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for user 69f5eaf4727f4bbf84ce10a5e07d582e and project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:36:43.149987 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b2e43925-b1a0-4d0b-9f0c-bb240c26c862 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.378793 Apr 12 00:36:43.150626 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 535/1045] 10.222.0.32 () {60 vars in 1157 bytes} [Tue Apr 12 00:36:42 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:43.291891 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-819f0ba3-28de-4fa5-9955-7b30e96a7862 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:43.299812 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-819f0ba3-28de-4fa5-9955-7b30e96a7862 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1265 microversion: 2.1 time: 0.240312 Apr 12 00:36:43.303326 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 511/1046] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:43 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:36:44.323543 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-27f78c42-f197-40b9-a009-a048a83e2670 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:44.325459 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-27f78c42-f197-40b9-a009-a048a83e2670 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:44.336994 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-27f78c42-f197-40b9-a009-a048a83e2670 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:44.338337 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-27f78c42-f197-40b9-a009-a048a83e2670 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:44.339406 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-27f78c42-f197-40b9-a009-a048a83e2670 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:44.339889 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-27f78c42-f197-40b9-a009-a048a83e2670 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:44.487475 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-27f78c42-f197-40b9-a009-a048a83e2670 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:44.494726 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-27f78c42-f197-40b9-a009-a048a83e2670 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1265 microversion: 2.1 time: 0.177965 Apr 12 00:36:44.495299 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 536/1047] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:44 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:44.776820 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e0c813db-e300-4d42-b685-ca5e260376d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-570383557", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad6fa16c-9ae9-409b-a431-15655dbe3bc7"}], "security_groups": [{"name": "tempest-securitygroup--84915049"}], "key_name": "tempest-keypair-1831034167", "user_data": "}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:44.900348 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.network.neutron [None req-e0c813db-e300-4d42-b685-ca5e260376d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] validate_networks() for [('ad6fa16c-9ae9-409b-a431-15655dbe3bc7', None, None, None, None, None)] {{(pid=128487) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:36:45.342910 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-e0c813db-e300-4d42-b685-ca5e260376d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Flavor limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:36:45.343356 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-e0c813db-e300-4d42-b685-ca5e260376d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Image limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:36:45.343824 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-e0c813db-e300-4d42-b685-ca5e260376d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Flavor pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:36:45.344415 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-e0c813db-e300-4d42-b685-ca5e260376d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Image pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:36:45.344820 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-e0c813db-e300-4d42-b685-ca5e260376d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:36:45.353616 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e0c813db-e300-4d42-b685-ca5e260376d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:45.354098 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e0c813db-e300-4d42-b685-ca5e260376d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:45.354973 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e0c813db-e300-4d42-b685-ca5e260376d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:45.355411 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e0c813db-e300-4d42-b685-ca5e260376d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:45.374921 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-e0c813db-e300-4d42-b685-ca5e260376d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:36:45.379046 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-e0c813db-e300-4d42-b685-ca5e260376d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for user 69f5eaf4727f4bbf84ce10a5e07d582e and project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:36:45.390551 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e0c813db-e300-4d42-b685-ca5e260376d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Going to run 1 instances... {{(pid=128487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:36:45.393086 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e0c813db-e300-4d42-b685-ca5e260376d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:36:45.443492 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e0c813db-e300-4d42-b685-ca5e260376d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.670981 Apr 12 00:36:45.444335 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 512/1048] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:36:44 2022] POST /compute/v2.1/servers => generated 400 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:36:45.455472 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-79dacde4-4476-409c-9862-6fed6eee6764 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:45.456263 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-79dacde4-4476-409c-9862-6fed6eee6764 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:45.511147 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-49437692-2b85-4b9d-b223-ae178a3eb38d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:45.512192 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-49437692-2b85-4b9d-b223-ae178a3eb38d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:45.520182 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-49437692-2b85-4b9d-b223-ae178a3eb38d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:45.520829 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-49437692-2b85-4b9d-b223-ae178a3eb38d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:45.521779 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-49437692-2b85-4b9d-b223-ae178a3eb38d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:45.522418 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-49437692-2b85-4b9d-b223-ae178a3eb38d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:45.526072 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-79dacde4-4476-409c-9862-6fed6eee6764 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:45.539047 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-79dacde4-4476-409c-9862-6fed6eee6764 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1241 microversion: 2.1 time: 0.088489 Apr 12 00:36:45.539666 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 537/1049] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:45 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:45.756403 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-49437692-2b85-4b9d-b223-ae178a3eb38d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:45.764122 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-49437692-2b85-4b9d-b223-ae178a3eb38d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1265 microversion: 2.1 time: 0.256782 Apr 12 00:36:45.764740 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 513/1050] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:45 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:36:46.555897 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f715b781-7dac-4d8a-a563-a063e7f7e868 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:46.558428 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f715b781-7dac-4d8a-a563-a063e7f7e868 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:46.565694 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f715b781-7dac-4d8a-a563-a063e7f7e868 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:46.566146 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f715b781-7dac-4d8a-a563-a063e7f7e868 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:46.567042 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f715b781-7dac-4d8a-a563-a063e7f7e868 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:46.567487 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f715b781-7dac-4d8a-a563-a063e7f7e868 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:46.636022 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f715b781-7dac-4d8a-a563-a063e7f7e868 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:46.643988 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f715b781-7dac-4d8a-a563-a063e7f7e868 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1301 microversion: 2.1 time: 0.092013 Apr 12 00:36:46.644560 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 538/1051] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:46 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:46.781402 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-7cfe10e3-229a-4e2f-abe3-56348d4e7f65 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:46.782831 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-7cfe10e3-229a-4e2f-abe3-56348d4e7f65 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:46.789582 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7cfe10e3-229a-4e2f-abe3-56348d4e7f65 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:46.790115 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7cfe10e3-229a-4e2f-abe3-56348d4e7f65 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:46.791034 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7cfe10e3-229a-4e2f-abe3-56348d4e7f65 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:46.791554 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7cfe10e3-229a-4e2f-abe3-56348d4e7f65 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:46.943745 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-7cfe10e3-229a-4e2f-abe3-56348d4e7f65 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:46.951179 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-7cfe10e3-229a-4e2f-abe3-56348d4e7f65 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1265 microversion: 2.1 time: 0.173747 Apr 12 00:36:46.951777 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 514/1052] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:46 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:47.661891 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-767ba2ec-d35d-4359-a6f8-b2927d8c2e1f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:47.662462 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-767ba2ec-d35d-4359-a6f8-b2927d8c2e1f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:47.669017 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-767ba2ec-d35d-4359-a6f8-b2927d8c2e1f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:47.669824 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-767ba2ec-d35d-4359-a6f8-b2927d8c2e1f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:47.671575 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-767ba2ec-d35d-4359-a6f8-b2927d8c2e1f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:47.671575 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-767ba2ec-d35d-4359-a6f8-b2927d8c2e1f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:47.815744 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-767ba2ec-d35d-4359-a6f8-b2927d8c2e1f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:47.824214 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-767ba2ec-d35d-4359-a6f8-b2927d8c2e1f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1365 microversion: 2.1 time: 0.166278 Apr 12 00:36:47.824835 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 539/1053] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:47 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:47.967218 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-71294069-8fb0-46a8-b18e-faa444fbccac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:47.969391 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-71294069-8fb0-46a8-b18e-faa444fbccac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:47.977749 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71294069-8fb0-46a8-b18e-faa444fbccac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:47.978428 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71294069-8fb0-46a8-b18e-faa444fbccac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:47.979211 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71294069-8fb0-46a8-b18e-faa444fbccac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:47.979873 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-71294069-8fb0-46a8-b18e-faa444fbccac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:48.174335 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-71294069-8fb0-46a8-b18e-faa444fbccac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:48.181730 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-71294069-8fb0-46a8-b18e-faa444fbccac tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1265 microversion: 2.1 time: 0.218604 Apr 12 00:36:48.182421 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 515/1054] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:47 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:48.209783 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-55a14025-6049-4169-9a0a-862c79a1ee0e req-68ea2b56-56b9-40c2-9b47-7f0e38769ffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca8227d3-6b1f-4d92-90c7-41de2b3054bd", "tag": "b26c3c3f-4a79-4918-90df-a275b5f37b5b"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:48.218462 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-55a14025-6049-4169-9a0a-862c79a1ee0e req-68ea2b56-56b9-40c2-9b47-7f0e38769ffb service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:48.218902 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-55a14025-6049-4169-9a0a-862c79a1ee0e req-68ea2b56-56b9-40c2-9b47-7f0e38769ffb service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:48.230727 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-55a14025-6049-4169-9a0a-862c79a1ee0e req-68ea2b56-56b9-40c2-9b47-7f0e38769ffb service nova] Creating event network-changed:b26c3c3f-4a79-4918-90df-a275b5f37b5b for instance ca8227d3-6b1f-4d92-90c7-41de2b3054bd on hv-cinder-83625 Apr 12 00:36:48.237432 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-55a14025-6049-4169-9a0a-862c79a1ee0e req-68ea2b56-56b9-40c2-9b47-7f0e38769ffb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031376 Apr 12 00:36:48.238111 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 540/1055] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:48.841142 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-135c3c7b-ba0e-4e13-a2c3-6d0dc6a776d8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:48.841748 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-135c3c7b-ba0e-4e13-a2c3-6d0dc6a776d8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:48.848168 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-135c3c7b-ba0e-4e13-a2c3-6d0dc6a776d8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:48.848614 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-135c3c7b-ba0e-4e13-a2c3-6d0dc6a776d8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:48.849365 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-135c3c7b-ba0e-4e13-a2c3-6d0dc6a776d8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:48.849794 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-135c3c7b-ba0e-4e13-a2c3-6d0dc6a776d8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:48.983248 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-135c3c7b-ba0e-4e13-a2c3-6d0dc6a776d8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:48.991658 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-135c3c7b-ba0e-4e13-a2c3-6d0dc6a776d8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1365 microversion: 2.1 time: 0.154310 Apr 12 00:36:48.992244 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 516/1056] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:48 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:49.200390 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3265c1ae-5250-42d7-a7f2-057281e91def tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:49.201022 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3265c1ae-5250-42d7-a7f2-057281e91def tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:49.207824 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3265c1ae-5250-42d7-a7f2-057281e91def tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:49.208274 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3265c1ae-5250-42d7-a7f2-057281e91def tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:49.209047 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3265c1ae-5250-42d7-a7f2-057281e91def tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:49.209481 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3265c1ae-5250-42d7-a7f2-057281e91def tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:49.338599 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3265c1ae-5250-42d7-a7f2-057281e91def tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:49.346516 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3265c1ae-5250-42d7-a7f2-057281e91def tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1265 microversion: 2.1 time: 0.150925 Apr 12 00:36:49.347080 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 541/1057] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:49 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:50.008433 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a5959dcf-9556-4769-b5ae-7fd3649861b5 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:50.009541 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a5959dcf-9556-4769-b5ae-7fd3649861b5 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:50.016447 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a5959dcf-9556-4769-b5ae-7fd3649861b5 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:50.016893 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a5959dcf-9556-4769-b5ae-7fd3649861b5 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:50.017854 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a5959dcf-9556-4769-b5ae-7fd3649861b5 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:50.018476 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a5959dcf-9556-4769-b5ae-7fd3649861b5 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:50.178634 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a5959dcf-9556-4769-b5ae-7fd3649861b5 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:50.186156 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a5959dcf-9556-4769-b5ae-7fd3649861b5 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1365 microversion: 2.1 time: 0.181589 Apr 12 00:36:50.186826 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 517/1058] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:50 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:50.363302 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b853e3bf-c0f1-4e1d-b738-5e665a3e9db4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:50.363944 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b853e3bf-c0f1-4e1d-b738-5e665a3e9db4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:50.370270 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b853e3bf-c0f1-4e1d-b738-5e665a3e9db4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:50.370736 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b853e3bf-c0f1-4e1d-b738-5e665a3e9db4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:50.371533 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b853e3bf-c0f1-4e1d-b738-5e665a3e9db4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:50.371969 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b853e3bf-c0f1-4e1d-b738-5e665a3e9db4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:50.504776 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-b853e3bf-c0f1-4e1d-b738-5e665a3e9db4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:50.517415 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b853e3bf-c0f1-4e1d-b738-5e665a3e9db4 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1265 microversion: 2.1 time: 0.158225 Apr 12 00:36:50.518415 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 542/1059] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:50 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:51.203372 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-731904c2-839c-4829-831a-f85aa1dc9c11 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:51.203980 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-731904c2-839c-4829-831a-f85aa1dc9c11 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:51.210283 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-731904c2-839c-4829-831a-f85aa1dc9c11 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:51.210733 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-731904c2-839c-4829-831a-f85aa1dc9c11 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:51.211494 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-731904c2-839c-4829-831a-f85aa1dc9c11 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:51.211926 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-731904c2-839c-4829-831a-f85aa1dc9c11 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:51.337684 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-731904c2-839c-4829-831a-f85aa1dc9c11 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:51.344883 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-731904c2-839c-4829-831a-f85aa1dc9c11 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1365 microversion: 2.1 time: 0.145886 Apr 12 00:36:51.345446 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 518/1060] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:51 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:51.534098 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a57b5237-74ec-47bf-b668-6fab9877ca59 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:51.534740 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a57b5237-74ec-47bf-b668-6fab9877ca59 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:51.540995 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a57b5237-74ec-47bf-b668-6fab9877ca59 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:51.541458 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a57b5237-74ec-47bf-b668-6fab9877ca59 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:51.542212 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a57b5237-74ec-47bf-b668-6fab9877ca59 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:51.542676 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a57b5237-74ec-47bf-b668-6fab9877ca59 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:51.668718 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a57b5237-74ec-47bf-b668-6fab9877ca59 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:51.676604 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a57b5237-74ec-47bf-b668-6fab9877ca59 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1265 microversion: 2.1 time: 0.146347 Apr 12 00:36:51.677160 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 543/1061] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:51 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:52.361937 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c5f62521-e386-4085-9878-c4698045ac24 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:52.362585 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c5f62521-e386-4085-9878-c4698045ac24 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:52.368828 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c5f62521-e386-4085-9878-c4698045ac24 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:52.369277 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c5f62521-e386-4085-9878-c4698045ac24 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:52.370032 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c5f62521-e386-4085-9878-c4698045ac24 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:52.370499 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c5f62521-e386-4085-9878-c4698045ac24 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:52.503849 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c5f62521-e386-4085-9878-c4698045ac24 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:52.511103 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c5f62521-e386-4085-9878-c4698045ac24 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1365 microversion: 2.1 time: 0.153487 Apr 12 00:36:52.511673 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 519/1062] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:52 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:52.692970 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-294635c0-f4d3-4886-ab49-ae59fe532666 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:52.693602 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-294635c0-f4d3-4886-ab49-ae59fe532666 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:52.699907 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-294635c0-f4d3-4886-ab49-ae59fe532666 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:52.700358 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-294635c0-f4d3-4886-ab49-ae59fe532666 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:52.701108 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-294635c0-f4d3-4886-ab49-ae59fe532666 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:52.701595 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-294635c0-f4d3-4886-ab49-ae59fe532666 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:52.831551 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-294635c0-f4d3-4886-ab49-ae59fe532666 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:52.840094 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-294635c0-f4d3-4886-ab49-ae59fe532666 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1265 microversion: 2.1 time: 0.151063 Apr 12 00:36:52.840663 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 544/1063] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:52 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:53.527982 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a7d4af1c-04e2-4efd-8400-90defbd49e89 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:53.528699 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a7d4af1c-04e2-4efd-8400-90defbd49e89 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:53.535915 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a7d4af1c-04e2-4efd-8400-90defbd49e89 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:53.536391 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a7d4af1c-04e2-4efd-8400-90defbd49e89 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:53.537316 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a7d4af1c-04e2-4efd-8400-90defbd49e89 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:53.537813 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a7d4af1c-04e2-4efd-8400-90defbd49e89 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:53.666703 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a7d4af1c-04e2-4efd-8400-90defbd49e89 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:53.674937 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a7d4af1c-04e2-4efd-8400-90defbd49e89 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1365 microversion: 2.1 time: 0.150857 Apr 12 00:36:53.675893 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 520/1064] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:53 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:53.856984 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0c83e9da-fe2a-4537-b46b-b490976db317 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:53.857603 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0c83e9da-fe2a-4537-b46b-b490976db317 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:53.863980 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0c83e9da-fe2a-4537-b46b-b490976db317 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:53.864461 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0c83e9da-fe2a-4537-b46b-b490976db317 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:53.865310 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0c83e9da-fe2a-4537-b46b-b490976db317 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:53.865772 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0c83e9da-fe2a-4537-b46b-b490976db317 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:53.996198 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0c83e9da-fe2a-4537-b46b-b490976db317 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:54.004513 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0c83e9da-fe2a-4537-b46b-b490976db317 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1265 microversion: 2.1 time: 0.151398 Apr 12 00:36:54.005262 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 545/1065] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:53 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:54.067444 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-e8613b78-f8be-4585-8fd4-b5207269f8a4 req-a8446d64-9c2a-478b-90fd-88934247b537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f92fc1-03bb-4d20-959e-fb9cd283f51a", "name": "network-vif-plugged", "status": "completed", "tag": "6de8e31e-e087-40aa-a319-0647d34795ca"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:54.075640 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-e8613b78-f8be-4585-8fd4-b5207269f8a4 req-a8446d64-9c2a-478b-90fd-88934247b537 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:54.076158 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-e8613b78-f8be-4585-8fd4-b5207269f8a4 req-a8446d64-9c2a-478b-90fd-88934247b537 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:54.087851 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-e8613b78-f8be-4585-8fd4-b5207269f8a4 req-a8446d64-9c2a-478b-90fd-88934247b537 service nova] Creating event network-vif-plugged:6de8e31e-e087-40aa-a319-0647d34795ca for instance b7f92fc1-03bb-4d20-959e-fb9cd283f51a on hv-cinder-83625 Apr 12 00:36:54.092834 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-e8613b78-f8be-4585-8fd4-b5207269f8a4 req-a8446d64-9c2a-478b-90fd-88934247b537 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091174 Apr 12 00:36:54.093344 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 521/1066] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:54.691867 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-47034786-9783-4f2d-919e-eb0cbe00b622 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:54.692476 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-47034786-9783-4f2d-919e-eb0cbe00b622 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:54.698438 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-47034786-9783-4f2d-919e-eb0cbe00b622 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:54.698884 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-47034786-9783-4f2d-919e-eb0cbe00b622 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:54.699632 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-47034786-9783-4f2d-919e-eb0cbe00b622 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:54.700095 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-47034786-9783-4f2d-919e-eb0cbe00b622 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:54.824085 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-47034786-9783-4f2d-919e-eb0cbe00b622 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:54.831249 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-47034786-9783-4f2d-919e-eb0cbe00b622 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1365 microversion: 2.1 time: 0.143289 Apr 12 00:36:54.831809 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 546/1067] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:54 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:55.024948 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f339a4a5-e402-4bcc-b06b-73a6ad03fba2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:55.025681 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f339a4a5-e402-4bcc-b06b-73a6ad03fba2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:55.031922 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f339a4a5-e402-4bcc-b06b-73a6ad03fba2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:55.032369 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f339a4a5-e402-4bcc-b06b-73a6ad03fba2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:55.033124 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f339a4a5-e402-4bcc-b06b-73a6ad03fba2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:55.033558 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f339a4a5-e402-4bcc-b06b-73a6ad03fba2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:55.159076 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f339a4a5-e402-4bcc-b06b-73a6ad03fba2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:55.166337 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f339a4a5-e402-4bcc-b06b-73a6ad03fba2 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1265 microversion: 2.1 time: 0.146060 Apr 12 00:36:55.166911 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 522/1068] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:55 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:55.850298 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-bc1162f6-68d4-49c0-b357-14a2787c4a1d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:55.851054 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-bc1162f6-68d4-49c0-b357-14a2787c4a1d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:55.860415 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bc1162f6-68d4-49c0-b357-14a2787c4a1d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:55.861171 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bc1162f6-68d4-49c0-b357-14a2787c4a1d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:55.862533 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bc1162f6-68d4-49c0-b357-14a2787c4a1d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:55.863248 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bc1162f6-68d4-49c0-b357-14a2787c4a1d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:55.994275 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-bc1162f6-68d4-49c0-b357-14a2787c4a1d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:56.002139 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-bc1162f6-68d4-49c0-b357-14a2787c4a1d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1365 microversion: 2.1 time: 0.157266 Apr 12 00:36:56.002775 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 547/1069] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:55 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:56.183329 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-578b796f-03ce-48c5-8e13-d9d4719ea9e5 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:56.183939 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-578b796f-03ce-48c5-8e13-d9d4719ea9e5 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:56.190183 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-578b796f-03ce-48c5-8e13-d9d4719ea9e5 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:56.190663 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-578b796f-03ce-48c5-8e13-d9d4719ea9e5 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:56.191413 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-578b796f-03ce-48c5-8e13-d9d4719ea9e5 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:56.191841 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-578b796f-03ce-48c5-8e13-d9d4719ea9e5 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:56.324531 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-578b796f-03ce-48c5-8e13-d9d4719ea9e5 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:56.331901 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-578b796f-03ce-48c5-8e13-d9d4719ea9e5 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1265 microversion: 2.1 time: 0.152449 Apr 12 00:36:56.332455 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 523/1070] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:56 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:57.019942 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7b48a4e4-d629-453c-8c19-26a383840654 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:57.020582 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7b48a4e4-d629-453c-8c19-26a383840654 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:57.026840 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b48a4e4-d629-453c-8c19-26a383840654 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:57.027307 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b48a4e4-d629-453c-8c19-26a383840654 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:57.028059 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b48a4e4-d629-453c-8c19-26a383840654 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:57.028489 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b48a4e4-d629-453c-8c19-26a383840654 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:57.152781 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7b48a4e4-d629-453c-8c19-26a383840654 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:57.160007 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7b48a4e4-d629-453c-8c19-26a383840654 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1365 microversion: 2.1 time: 0.144213 Apr 12 00:36:57.160594 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 548/1071] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:57 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:57.348290 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-af4576de-fa9a-4e6b-9713-a36c1869d471 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:57.348921 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-af4576de-fa9a-4e6b-9713-a36c1869d471 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:57.355202 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-af4576de-fa9a-4e6b-9713-a36c1869d471 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:57.355565 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-af4576de-fa9a-4e6b-9713-a36c1869d471 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:57.356317 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-af4576de-fa9a-4e6b-9713-a36c1869d471 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:57.356746 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-af4576de-fa9a-4e6b-9713-a36c1869d471 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:57.491848 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-af4576de-fa9a-4e6b-9713-a36c1869d471 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:57.499049 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-af4576de-fa9a-4e6b-9713-a36c1869d471 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1265 microversion: 2.1 time: 0.154627 Apr 12 00:36:57.500210 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 524/1072] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:57 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:57.988255 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-d2f745ea-be76-4a3d-8acc-5e13980fedab req-0bce9738-c694-4505-b5cf-3d8aa27c58dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca8227d3-6b1f-4d92-90c7-41de2b3054bd", "name": "network-vif-plugged", "status": "completed", "tag": "b26c3c3f-4a79-4918-90df-a275b5f37b5b"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:57.996325 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-d2f745ea-be76-4a3d-8acc-5e13980fedab req-0bce9738-c694-4505-b5cf-3d8aa27c58dd service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:57.996821 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-d2f745ea-be76-4a3d-8acc-5e13980fedab req-0bce9738-c694-4505-b5cf-3d8aa27c58dd service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:58.007826 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-d2f745ea-be76-4a3d-8acc-5e13980fedab req-0bce9738-c694-4505-b5cf-3d8aa27c58dd service nova] Creating event network-vif-plugged:b26c3c3f-4a79-4918-90df-a275b5f37b5b for instance ca8227d3-6b1f-4d92-90c7-41de2b3054bd on hv-cinder-83625 Apr 12 00:36:58.012718 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-d2f745ea-be76-4a3d-8acc-5e13980fedab req-0bce9738-c694-4505-b5cf-3d8aa27c58dd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028871 Apr 12 00:36:58.013299 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 549/1073] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:58.176614 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-019c69f2-b4ad-4138-aed2-5c17a8f463ac tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:58.177226 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-019c69f2-b4ad-4138-aed2-5c17a8f463ac tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:58.183040 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-019c69f2-b4ad-4138-aed2-5c17a8f463ac tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:58.183496 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-019c69f2-b4ad-4138-aed2-5c17a8f463ac tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:58.184355 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-019c69f2-b4ad-4138-aed2-5c17a8f463ac tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:58.184799 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-019c69f2-b4ad-4138-aed2-5c17a8f463ac tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:58.321124 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-019c69f2-b4ad-4138-aed2-5c17a8f463ac tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:58.329084 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-019c69f2-b4ad-4138-aed2-5c17a8f463ac tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1365 microversion: 2.1 time: 0.156280 Apr 12 00:36:58.329658 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 525/1074] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:58 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:58.517544 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ddd0d24b-eca5-42d7-ad8d-9d7839419cec tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:58.518360 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ddd0d24b-eca5-42d7-ad8d-9d7839419cec tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:58.524741 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ddd0d24b-eca5-42d7-ad8d-9d7839419cec tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:58.525184 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ddd0d24b-eca5-42d7-ad8d-9d7839419cec tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:58.525945 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ddd0d24b-eca5-42d7-ad8d-9d7839419cec tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:58.526420 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ddd0d24b-eca5-42d7-ad8d-9d7839419cec tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:58.672909 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ddd0d24b-eca5-42d7-ad8d-9d7839419cec tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:58.680567 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ddd0d24b-eca5-42d7-ad8d-9d7839419cec tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1451 microversion: 2.1 time: 0.168020 Apr 12 00:36:58.681160 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 550/1075] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:58 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:58.697164 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-48b4080f-4d7e-4585-b729-23925299ac0d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:58.697856 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-48b4080f-4d7e-4585-b729-23925299ac0d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:58.705054 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-48b4080f-4d7e-4585-b729-23925299ac0d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:58.705500 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-48b4080f-4d7e-4585-b729-23925299ac0d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:58.706494 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-48b4080f-4d7e-4585-b729-23925299ac0d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:58.707114 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-48b4080f-4d7e-4585-b729-23925299ac0d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:58.888171 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-48b4080f-4d7e-4585-b729-23925299ac0d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:58.896135 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-48b4080f-4d7e-4585-b729-23925299ac0d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1451 microversion: 2.1 time: 0.202821 Apr 12 00:36:58.896699 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 526/1076] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:58 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1451 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:59.346632 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a52d9c4f-d7cf-4d15-9b1f-540a23bda66b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:59.347412 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a52d9c4f-d7cf-4d15-9b1f-540a23bda66b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:36:59.355525 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a52d9c4f-d7cf-4d15-9b1f-540a23bda66b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:59.356047 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a52d9c4f-d7cf-4d15-9b1f-540a23bda66b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:59.356930 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a52d9c4f-d7cf-4d15-9b1f-540a23bda66b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:36:59.357347 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a52d9c4f-d7cf-4d15-9b1f-540a23bda66b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:36:59.491412 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a52d9c4f-d7cf-4d15-9b1f-540a23bda66b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:36:59.499239 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a52d9c4f-d7cf-4d15-9b1f-540a23bda66b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1365 microversion: 2.1 time: 0.156996 Apr 12 00:36:59.499858 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 551/1077] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:36:59 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:00.517143 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b68d8216-2bf7-446c-bae9-e671ed583df4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:00.517793 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b68d8216-2bf7-446c-bae9-e671ed583df4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:00.526110 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b68d8216-2bf7-446c-bae9-e671ed583df4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:00.526833 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b68d8216-2bf7-446c-bae9-e671ed583df4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:00.527620 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b68d8216-2bf7-446c-bae9-e671ed583df4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:00.528051 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b68d8216-2bf7-446c-bae9-e671ed583df4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:00.724331 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b68d8216-2bf7-446c-bae9-e671ed583df4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:37:00.731804 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b68d8216-2bf7-446c-bae9-e671ed583df4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1365 microversion: 2.1 time: 0.219661 Apr 12 00:37:00.742717 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 527/1078] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:37:00 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:00.746888 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-24fbfd12-a037-4639-b682-895af22bcb91 req-aaeb585d-5615-4f00-a7a8-438da88640a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f92fc1-03bb-4d20-959e-fb9cd283f51a", "tag": "6de8e31e-e087-40aa-a319-0647d34795ca"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:00.755404 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-24fbfd12-a037-4639-b682-895af22bcb91 req-aaeb585d-5615-4f00-a7a8-438da88640a7 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:00.755851 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-24fbfd12-a037-4639-b682-895af22bcb91 req-aaeb585d-5615-4f00-a7a8-438da88640a7 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:00.767895 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-24fbfd12-a037-4639-b682-895af22bcb91 req-aaeb585d-5615-4f00-a7a8-438da88640a7 service nova] Creating event network-changed:6de8e31e-e087-40aa-a319-0647d34795ca for instance b7f92fc1-03bb-4d20-959e-fb9cd283f51a on hv-cinder-83625 Apr 12 00:37:00.773067 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-24fbfd12-a037-4639-b682-895af22bcb91 req-aaeb585d-5615-4f00-a7a8-438da88640a7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029803 Apr 12 00:37:00.774362 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 552/1079] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:37:01.749762 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-bf035f71-f35d-483f-b4e8-8186708d7971 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:01.750569 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-bf035f71-f35d-483f-b4e8-8186708d7971 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:01.757143 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bf035f71-f35d-483f-b4e8-8186708d7971 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:01.757596 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bf035f71-f35d-483f-b4e8-8186708d7971 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:01.758407 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bf035f71-f35d-483f-b4e8-8186708d7971 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:01.758876 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bf035f71-f35d-483f-b4e8-8186708d7971 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:01.892805 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-bf035f71-f35d-483f-b4e8-8186708d7971 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:37:01.900196 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-bf035f71-f35d-483f-b4e8-8186708d7971 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1556 microversion: 2.1 time: 0.154821 Apr 12 00:37:01.900705 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 528/1080] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:37:01 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:01.918014 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ef4f5c0b-466a-4e69-988e-6bb755d70bcf tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:01.918713 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ef4f5c0b-466a-4e69-988e-6bb755d70bcf tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:01.925690 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ef4f5c0b-466a-4e69-988e-6bb755d70bcf tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:01.926231 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ef4f5c0b-466a-4e69-988e-6bb755d70bcf tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:01.927227 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ef4f5c0b-466a-4e69-988e-6bb755d70bcf tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:01.927726 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ef4f5c0b-466a-4e69-988e-6bb755d70bcf tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:02.014993 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ef4f5c0b-466a-4e69-988e-6bb755d70bcf tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101658 Apr 12 00:37:02.016074 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 553/1081] 10.222.0.32 () {58 vars in 1274 bytes} [Tue Apr 12 00:37:01 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:37:03.085029 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-61ba1e8c-a615-410a-9a47-2e8bc315579b req-2e224bec-9663-4751-935f-d4024ce60847 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca8227d3-6b1f-4d92-90c7-41de2b3054bd", "tag": "b26c3c3f-4a79-4918-90df-a275b5f37b5b"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:03.093372 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-61ba1e8c-a615-410a-9a47-2e8bc315579b req-2e224bec-9663-4751-935f-d4024ce60847 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:03.093810 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-61ba1e8c-a615-410a-9a47-2e8bc315579b req-2e224bec-9663-4751-935f-d4024ce60847 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:03.104328 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-61ba1e8c-a615-410a-9a47-2e8bc315579b req-2e224bec-9663-4751-935f-d4024ce60847 service nova] Creating event network-changed:b26c3c3f-4a79-4918-90df-a275b5f37b5b for instance ca8227d3-6b1f-4d92-90c7-41de2b3054bd on hv-cinder-83625 Apr 12 00:37:03.109408 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-61ba1e8c-a615-410a-9a47-2e8bc315579b req-2e224bec-9663-4751-935f-d4024ce60847 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140894 Apr 12 00:37:03.109959 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 529/1082] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:43.668367 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-613723b5-1f44-4a9d-9041-a02b982674a5 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Action: 'create', calling method: .version_select at 0x7f64e11ca0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1916231708"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:43.682134 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-613723b5-1f44-4a9d-9041-a02b982674a5 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Getting quotas for project ba38491d23d64bd58eabf7ea16fd68e8. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:37:43.686400 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-613723b5-1f44-4a9d-9041-a02b982674a5 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Getting quotas for user fea857a427b0464daf88491b3d4ecbc3 and project ba38491d23d64bd58eabf7ea16fd68e8. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:37:43.862723 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-613723b5-1f44-4a9d-9041-a02b982674a5 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Getting quotas for project ba38491d23d64bd58eabf7ea16fd68e8. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:37:43.866169 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-613723b5-1f44-4a9d-9041-a02b982674a5 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Getting quotas for user fea857a427b0464daf88491b3d4ecbc3 and project ba38491d23d64bd58eabf7ea16fd68e8. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:37:43.879532 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-613723b5-1f44-4a9d-9041-a02b982674a5 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.215827 Apr 12 00:37:43.880141 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 554/1083] 10.222.0.32 () {60 vars in 1157 bytes} [Tue Apr 12 00:37:43 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:43.928931 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-fc81cadd-f9b8-4ebf-bc6c-2d390a395315 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1167835986", "imageRef": "10584796-bf05-460f-876b-80ed4acbffc3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1916231708", "networks": [{"uuid": "468ee0a2-580f-4c3a-8cc5-2cad68c7110d"}]}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:43.976854 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.network.neutron [None req-fc81cadd-f9b8-4ebf-bc6c-2d390a395315 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] validate_networks() for [('468ee0a2-580f-4c3a-8cc5-2cad68c7110d', None, None, None, None, None)] {{(pid=128487) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:37:44.421640 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-fc81cadd-f9b8-4ebf-bc6c-2d390a395315 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Flavor limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:37:44.422060 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-fc81cadd-f9b8-4ebf-bc6c-2d390a395315 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Image limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:37:44.422561 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-fc81cadd-f9b8-4ebf-bc6c-2d390a395315 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Flavor pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:37:44.422963 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-fc81cadd-f9b8-4ebf-bc6c-2d390a395315 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Image pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:37:44.423364 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-fc81cadd-f9b8-4ebf-bc6c-2d390a395315 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:37:44.431766 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fc81cadd-f9b8-4ebf-bc6c-2d390a395315 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:44.432211 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fc81cadd-f9b8-4ebf-bc6c-2d390a395315 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:44.433001 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fc81cadd-f9b8-4ebf-bc6c-2d390a395315 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:44.433431 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-fc81cadd-f9b8-4ebf-bc6c-2d390a395315 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:44.449375 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-fc81cadd-f9b8-4ebf-bc6c-2d390a395315 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Getting quotas for project ba38491d23d64bd58eabf7ea16fd68e8. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:37:44.453170 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-fc81cadd-f9b8-4ebf-bc6c-2d390a395315 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Getting quotas for user fea857a427b0464daf88491b3d4ecbc3 and project ba38491d23d64bd58eabf7ea16fd68e8. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:37:44.463531 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-fc81cadd-f9b8-4ebf-bc6c-2d390a395315 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Going to run 1 instances... {{(pid=128487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:37:44.465753 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-fc81cadd-f9b8-4ebf-bc6c-2d390a395315 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10584796-bf05-460f-876b-80ed4acbffc3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:37:44.508720 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-fc81cadd-f9b8-4ebf-bc6c-2d390a395315 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584670 Apr 12 00:37:44.509355 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 530/1084] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:37:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:37:44.519940 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-af67386b-7205-45ba-9864-2f1324a1f76b tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:44.520557 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-af67386b-7205-45ba-9864-2f1324a1f76b tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:44.573150 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-af67386b-7205-45ba-9864-2f1324a1f76b tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:37:44.580992 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-af67386b-7205-45ba-9864-2f1324a1f76b tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1259 microversion: 2.1 time: 0.065248 Apr 12 00:37:44.581557 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 555/1085] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:37:44 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:45.599087 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-345f201f-7343-4fb4-a055-03a6d056f3ce tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:45.599699 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-345f201f-7343-4fb4-a055-03a6d056f3ce tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:45.606553 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-345f201f-7343-4fb4-a055-03a6d056f3ce tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:45.607031 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-345f201f-7343-4fb4-a055-03a6d056f3ce tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:45.607785 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-345f201f-7343-4fb4-a055-03a6d056f3ce tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:45.608212 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-345f201f-7343-4fb4-a055-03a6d056f3ce tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:45.703276 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-345f201f-7343-4fb4-a055-03a6d056f3ce tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:37:45.710629 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-345f201f-7343-4fb4-a055-03a6d056f3ce tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1319 microversion: 2.1 time: 0.115901 Apr 12 00:37:45.713949 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 531/1086] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:37:45 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1319 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:46.727691 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5ad71212-fd54-4dbf-9ef0-e402169a8dee tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:46.728286 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5ad71212-fd54-4dbf-9ef0-e402169a8dee tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:46.740544 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5ad71212-fd54-4dbf-9ef0-e402169a8dee tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:46.741000 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5ad71212-fd54-4dbf-9ef0-e402169a8dee tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:46.741837 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5ad71212-fd54-4dbf-9ef0-e402169a8dee tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:46.742276 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5ad71212-fd54-4dbf-9ef0-e402169a8dee tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:46.877221 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5ad71212-fd54-4dbf-9ef0-e402169a8dee tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:37:46.885081 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5ad71212-fd54-4dbf-9ef0-e402169a8dee tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.161221 Apr 12 00:37:46.885945 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 556/1087] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:37:46 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:47.903558 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5c03f54d-d443-475c-ad9e-c1b576aa2c70 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:47.905188 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5c03f54d-d443-475c-ad9e-c1b576aa2c70 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:47.915398 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5c03f54d-d443-475c-ad9e-c1b576aa2c70 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:47.915932 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5c03f54d-d443-475c-ad9e-c1b576aa2c70 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:47.916773 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5c03f54d-d443-475c-ad9e-c1b576aa2c70 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:47.917273 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5c03f54d-d443-475c-ad9e-c1b576aa2c70 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:48.055768 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-5c03f54d-d443-475c-ad9e-c1b576aa2c70 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:37:48.063630 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5c03f54d-d443-475c-ad9e-c1b576aa2c70 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.164792 Apr 12 00:37:48.064199 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 532/1088] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:37:47 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:49.080970 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-7b7e3dfa-2104-4001-b1dd-7160490f5618 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:49.081574 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-7b7e3dfa-2104-4001-b1dd-7160490f5618 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:49.087957 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b7e3dfa-2104-4001-b1dd-7160490f5618 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:49.088423 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b7e3dfa-2104-4001-b1dd-7160490f5618 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:49.089191 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b7e3dfa-2104-4001-b1dd-7160490f5618 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:49.089617 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-7b7e3dfa-2104-4001-b1dd-7160490f5618 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:49.223599 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-7b7e3dfa-2104-4001-b1dd-7160490f5618 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:37:49.230977 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-7b7e3dfa-2104-4001-b1dd-7160490f5618 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.154412 Apr 12 00:37:49.232026 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 557/1089] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:37:49 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:50.249196 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a774b999-3751-4d5b-9133-b05d77432bd2 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:50.249959 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a774b999-3751-4d5b-9133-b05d77432bd2 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:50.256375 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a774b999-3751-4d5b-9133-b05d77432bd2 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:50.257148 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a774b999-3751-4d5b-9133-b05d77432bd2 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:50.257973 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a774b999-3751-4d5b-9133-b05d77432bd2 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:50.258493 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a774b999-3751-4d5b-9133-b05d77432bd2 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:50.388683 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a774b999-3751-4d5b-9133-b05d77432bd2 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:37:50.396297 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a774b999-3751-4d5b-9133-b05d77432bd2 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.151831 Apr 12 00:37:50.397066 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 533/1090] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:37:50 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:51.412867 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4a3f0934-19dd-44c9-9804-374c36d84719 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:51.413480 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4a3f0934-19dd-44c9-9804-374c36d84719 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:51.420223 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4a3f0934-19dd-44c9-9804-374c36d84719 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:51.420680 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4a3f0934-19dd-44c9-9804-374c36d84719 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:51.421462 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4a3f0934-19dd-44c9-9804-374c36d84719 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:51.421905 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4a3f0934-19dd-44c9-9804-374c36d84719 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:51.557436 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-4a3f0934-19dd-44c9-9804-374c36d84719 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:37:51.564548 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4a3f0934-19dd-44c9-9804-374c36d84719 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.155473 Apr 12 00:37:51.569757 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 558/1091] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:37:51 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:52.582066 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-7aa3b285-cb66-46a1-80d0-a743c6c86e8c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:52.582773 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-7aa3b285-cb66-46a1-80d0-a743c6c86e8c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:52.589108 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7aa3b285-cb66-46a1-80d0-a743c6c86e8c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:52.589734 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7aa3b285-cb66-46a1-80d0-a743c6c86e8c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:52.590524 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7aa3b285-cb66-46a1-80d0-a743c6c86e8c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:52.591023 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7aa3b285-cb66-46a1-80d0-a743c6c86e8c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:52.737137 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-7aa3b285-cb66-46a1-80d0-a743c6c86e8c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:37:52.744877 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-7aa3b285-cb66-46a1-80d0-a743c6c86e8c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.166848 Apr 12 00:37:52.745687 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 534/1092] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:37:52 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:53.767768 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2209cfda-b943-4409-b557-6b02c9406bc6 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:53.768369 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-2209cfda-b943-4409-b557-6b02c9406bc6 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:53.774992 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2209cfda-b943-4409-b557-6b02c9406bc6 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:53.775436 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2209cfda-b943-4409-b557-6b02c9406bc6 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:53.776204 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2209cfda-b943-4409-b557-6b02c9406bc6 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:53.776635 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2209cfda-b943-4409-b557-6b02c9406bc6 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:53.952328 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2209cfda-b943-4409-b557-6b02c9406bc6 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:37:53.960222 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2209cfda-b943-4409-b557-6b02c9406bc6 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.197077 Apr 12 00:37:53.960796 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 559/1093] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:37:53 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:54.976227 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-03a34005-4cab-47dd-b40c-7f5232c6592d tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:54.977548 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-03a34005-4cab-47dd-b40c-7f5232c6592d tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:54.984507 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-03a34005-4cab-47dd-b40c-7f5232c6592d tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:54.984946 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-03a34005-4cab-47dd-b40c-7f5232c6592d tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:54.985736 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-03a34005-4cab-47dd-b40c-7f5232c6592d tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:54.986165 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-03a34005-4cab-47dd-b40c-7f5232c6592d tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:55.113217 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-03a34005-4cab-47dd-b40c-7f5232c6592d tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:37:55.120890 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-03a34005-4cab-47dd-b40c-7f5232c6592d tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.148639 Apr 12 00:37:55.121451 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 535/1094] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:37:54 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:37:56.138974 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1a964185-14f4-4a99-abb0-da283a33d955 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:56.139583 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1a964185-14f4-4a99-abb0-da283a33d955 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:56.146127 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1a964185-14f4-4a99-abb0-da283a33d955 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:56.146604 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1a964185-14f4-4a99-abb0-da283a33d955 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:56.147559 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1a964185-14f4-4a99-abb0-da283a33d955 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:56.147794 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1a964185-14f4-4a99-abb0-da283a33d955 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:56.271439 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1a964185-14f4-4a99-abb0-da283a33d955 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:37:56.278636 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1a964185-14f4-4a99-abb0-da283a33d955 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.143616 Apr 12 00:37:56.279695 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 560/1095] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:37:56 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:57.296459 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-6b65ff8e-0c55-455e-b8fb-edafcfee1583 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:57.297067 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-6b65ff8e-0c55-455e-b8fb-edafcfee1583 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:57.303280 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6b65ff8e-0c55-455e-b8fb-edafcfee1583 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:57.303731 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6b65ff8e-0c55-455e-b8fb-edafcfee1583 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:57.304490 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6b65ff8e-0c55-455e-b8fb-edafcfee1583 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:57.304922 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6b65ff8e-0c55-455e-b8fb-edafcfee1583 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:57.425601 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-6b65ff8e-0c55-455e-b8fb-edafcfee1583 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:37:57.432908 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-6b65ff8e-0c55-455e-b8fb-edafcfee1583 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.140768 Apr 12 00:37:57.433484 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 536/1096] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:37:57 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:58.450257 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-d9b59cc7-2832-45c1-b058-fff2cd9749ef tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:58.451076 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-d9b59cc7-2832-45c1-b058-fff2cd9749ef tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:58.457450 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d9b59cc7-2832-45c1-b058-fff2cd9749ef tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:58.457899 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d9b59cc7-2832-45c1-b058-fff2cd9749ef tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:58.458694 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d9b59cc7-2832-45c1-b058-fff2cd9749ef tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:58.459132 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d9b59cc7-2832-45c1-b058-fff2cd9749ef tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:58.583868 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-d9b59cc7-2832-45c1-b058-fff2cd9749ef tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:37:58.591049 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-d9b59cc7-2832-45c1-b058-fff2cd9749ef tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.144802 Apr 12 00:37:58.591666 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 561/1097] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:37:58 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:59.608442 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-bf0da262-5c2b-4e7a-ba1c-f85f4535ad14 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:59.609034 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-bf0da262-5c2b-4e7a-ba1c-f85f4535ad14 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:37:59.615514 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bf0da262-5c2b-4e7a-ba1c-f85f4535ad14 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:59.615959 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bf0da262-5c2b-4e7a-ba1c-f85f4535ad14 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:37:59.616726 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bf0da262-5c2b-4e7a-ba1c-f85f4535ad14 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:37:59.617155 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bf0da262-5c2b-4e7a-ba1c-f85f4535ad14 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:00.132691 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-bf0da262-5c2b-4e7a-ba1c-f85f4535ad14 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:00.142595 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-bf0da262-5c2b-4e7a-ba1c-f85f4535ad14 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.538092 Apr 12 00:38:00.143437 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 537/1098] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:37:59 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:00.255259 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-db486b07-8d7d-490b-b571-ae3453bbba06 req-70e9f417-e465-4fe6-8d50-f073e9b791c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ec626f-1d95-45d9-8293-40d6408a52d2", "tag": "f8104ec7-8594-4188-ae28-392ce2284da2"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:00.264317 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-db486b07-8d7d-490b-b571-ae3453bbba06 req-70e9f417-e465-4fe6-8d50-f073e9b791c6 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:00.264770 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-db486b07-8d7d-490b-b571-ae3453bbba06 req-70e9f417-e465-4fe6-8d50-f073e9b791c6 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:00.276228 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-db486b07-8d7d-490b-b571-ae3453bbba06 req-70e9f417-e465-4fe6-8d50-f073e9b791c6 service nova] Creating event network-changed:f8104ec7-8594-4188-ae28-392ce2284da2 for instance 90ec626f-1d95-45d9-8293-40d6408a52d2 on hv-cinder-83625 Apr 12 00:38:00.281202 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-db486b07-8d7d-490b-b571-ae3453bbba06 req-70e9f417-e465-4fe6-8d50-f073e9b791c6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179992 Apr 12 00:38:00.281855 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 562/1099] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:01.160081 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-bdcdbc94-dc45-4190-b8d5-bbcdf5b56502 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:01.160700 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-bdcdbc94-dc45-4190-b8d5-bbcdf5b56502 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:01.166964 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bdcdbc94-dc45-4190-b8d5-bbcdf5b56502 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:01.167422 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bdcdbc94-dc45-4190-b8d5-bbcdf5b56502 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:01.168189 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bdcdbc94-dc45-4190-b8d5-bbcdf5b56502 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:01.168631 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-bdcdbc94-dc45-4190-b8d5-bbcdf5b56502 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:01.295797 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-bdcdbc94-dc45-4190-b8d5-bbcdf5b56502 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:01.303080 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-bdcdbc94-dc45-4190-b8d5-bbcdf5b56502 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.146886 Apr 12 00:38:01.303658 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 538/1100] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:01 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:02.320694 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-16f843dc-dddb-4c1b-a89a-4b2ea19a0eac tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:02.321386 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-16f843dc-dddb-4c1b-a89a-4b2ea19a0eac tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:02.327471 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-16f843dc-dddb-4c1b-a89a-4b2ea19a0eac tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:02.327924 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-16f843dc-dddb-4c1b-a89a-4b2ea19a0eac tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:02.328685 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-16f843dc-dddb-4c1b-a89a-4b2ea19a0eac tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:02.329122 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-16f843dc-dddb-4c1b-a89a-4b2ea19a0eac tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:02.451062 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-16f843dc-dddb-4c1b-a89a-4b2ea19a0eac tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:02.458204 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-16f843dc-dddb-4c1b-a89a-4b2ea19a0eac tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.142162 Apr 12 00:38:02.458790 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 563/1101] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:02 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:03.474620 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d594ed75-c0bf-4deb-8025-f8bfd2b8a345 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:03.475230 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d594ed75-c0bf-4deb-8025-f8bfd2b8a345 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:03.481389 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d594ed75-c0bf-4deb-8025-f8bfd2b8a345 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:03.481836 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d594ed75-c0bf-4deb-8025-f8bfd2b8a345 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:03.483141 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d594ed75-c0bf-4deb-8025-f8bfd2b8a345 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:03.483618 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d594ed75-c0bf-4deb-8025-f8bfd2b8a345 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:03.696760 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d594ed75-c0bf-4deb-8025-f8bfd2b8a345 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:03.704128 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d594ed75-c0bf-4deb-8025-f8bfd2b8a345 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.233397 Apr 12 00:38:03.704703 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 539/1102] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:03 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:04.721033 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c4779eb2-f43a-473a-a281-09473cfc0dc0 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:04.721703 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c4779eb2-f43a-473a-a281-09473cfc0dc0 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:04.727880 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c4779eb2-f43a-473a-a281-09473cfc0dc0 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:04.728320 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c4779eb2-f43a-473a-a281-09473cfc0dc0 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:04.729078 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c4779eb2-f43a-473a-a281-09473cfc0dc0 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:04.729511 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c4779eb2-f43a-473a-a281-09473cfc0dc0 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:04.852876 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-c4779eb2-f43a-473a-a281-09473cfc0dc0 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:04.861439 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c4779eb2-f43a-473a-a281-09473cfc0dc0 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.144349 Apr 12 00:38:04.862003 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 564/1103] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:04 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:05.878628 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-cf79b2fc-660d-4429-b9fe-88a83cd34145 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:05.879171 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-cf79b2fc-660d-4429-b9fe-88a83cd34145 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:05.885416 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cf79b2fc-660d-4429-b9fe-88a83cd34145 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:05.885869 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cf79b2fc-660d-4429-b9fe-88a83cd34145 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:05.886658 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cf79b2fc-660d-4429-b9fe-88a83cd34145 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:05.887094 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cf79b2fc-660d-4429-b9fe-88a83cd34145 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:06.008514 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-cf79b2fc-660d-4429-b9fe-88a83cd34145 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:06.015973 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-cf79b2fc-660d-4429-b9fe-88a83cd34145 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.141096 Apr 12 00:38:06.016539 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 540/1104] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:05 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:06.307638 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-6fe91141-1e3b-46de-b5ea-26596e084b8d req-784b407b-c977-40f6-957a-4afc71d84e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ec626f-1d95-45d9-8293-40d6408a52d2", "name": "network-vif-plugged", "status": "completed", "tag": "f8104ec7-8594-4188-ae28-392ce2284da2"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:06.316811 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-6fe91141-1e3b-46de-b5ea-26596e084b8d req-784b407b-c977-40f6-957a-4afc71d84e6e service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:06.317327 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-6fe91141-1e3b-46de-b5ea-26596e084b8d req-784b407b-c977-40f6-957a-4afc71d84e6e service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:06.329102 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-6fe91141-1e3b-46de-b5ea-26596e084b8d req-784b407b-c977-40f6-957a-4afc71d84e6e service nova] Creating event network-vif-plugged:f8104ec7-8594-4188-ae28-392ce2284da2 for instance 90ec626f-1d95-45d9-8293-40d6408a52d2 on hv-cinder-83625 Apr 12 00:38:06.334034 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-6fe91141-1e3b-46de-b5ea-26596e084b8d req-784b407b-c977-40f6-957a-4afc71d84e6e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030088 Apr 12 00:38:06.334836 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 565/1105] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:07.032774 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9704e1a8-5f31-4168-bbe5-57443c24b87f tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:07.033400 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-9704e1a8-5f31-4168-bbe5-57443c24b87f tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:07.039389 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9704e1a8-5f31-4168-bbe5-57443c24b87f tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:07.039839 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9704e1a8-5f31-4168-bbe5-57443c24b87f tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:07.040595 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9704e1a8-5f31-4168-bbe5-57443c24b87f tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:07.041031 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9704e1a8-5f31-4168-bbe5-57443c24b87f tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:07.162491 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9704e1a8-5f31-4168-bbe5-57443c24b87f tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:07.170097 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9704e1a8-5f31-4168-bbe5-57443c24b87f tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1359 microversion: 2.1 time: 0.140691 Apr 12 00:38:07.170713 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 541/1106] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:07 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1359 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:08.187300 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0c209a2e-71a4-4f31-9ca4-ead2b1dd90ff tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:08.187988 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0c209a2e-71a4-4f31-9ca4-ead2b1dd90ff tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:08.194527 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0c209a2e-71a4-4f31-9ca4-ead2b1dd90ff tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:08.194978 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0c209a2e-71a4-4f31-9ca4-ead2b1dd90ff tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:08.195743 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0c209a2e-71a4-4f31-9ca4-ead2b1dd90ff tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:08.196177 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0c209a2e-71a4-4f31-9ca4-ead2b1dd90ff tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:08.322767 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0c209a2e-71a4-4f31-9ca4-ead2b1dd90ff tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:08.330550 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0c209a2e-71a4-4f31-9ca4-ead2b1dd90ff tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1548 microversion: 2.1 time: 0.147450 Apr 12 00:38:08.331116 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 566/1107] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:08 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:08.346215 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3fadc5e5-3c96-4568-8081-7ee66cb3134b tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:08.346859 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3fadc5e5-3c96-4568-8081-7ee66cb3134b tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:08.353018 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3fadc5e5-3c96-4568-8081-7ee66cb3134b tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:08.353465 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3fadc5e5-3c96-4568-8081-7ee66cb3134b tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:08.354223 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3fadc5e5-3c96-4568-8081-7ee66cb3134b tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:08.354680 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3fadc5e5-3c96-4568-8081-7ee66cb3134b tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:08.479200 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-3fadc5e5-3c96-4568-8081-7ee66cb3134b tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:08.486970 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3fadc5e5-3c96-4568-8081-7ee66cb3134b tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1548 microversion: 2.1 time: 0.144602 Apr 12 00:38:08.487541 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 542/1108] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:08 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:08.502377 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-bd7e029b-1169-4eec-8dc1-984337f8815c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:08.505964 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-bd7e029b-1169-4eec-8dc1-984337f8815c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:08.506748 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-bd7e029b-1169-4eec-8dc1-984337f8815c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Searching by: {'deleted': False, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8'} {{(pid=128486) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 12 00:38:08.513036 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bd7e029b-1169-4eec-8dc1-984337f8815c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:08.513990 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bd7e029b-1169-4eec-8dc1-984337f8815c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:08.514801 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bd7e029b-1169-4eec-8dc1-984337f8815c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:08.515226 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bd7e029b-1169-4eec-8dc1-984337f8815c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:08.606692 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.multi_cell_list [None req-bd7e029b-1169-4eec-8dc1-984337f8815c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128486) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 00:38:08.697681 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-bd7e029b-1169-4eec-8dc1-984337f8815c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198964 Apr 12 00:38:08.698276 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 567/1109] 10.222.0.32 () {58 vars in 1124 bytes} [Tue Apr 12 00:38:08 2022] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:08.708904 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-de874f57-ff9f-4f31-a2c4-71810b8ce5ec tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:08.709522 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-de874f57-ff9f-4f31-a2c4-71810b8ce5ec tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:08.715319 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-de874f57-ff9f-4f31-a2c4-71810b8ce5ec tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:08.715772 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-de874f57-ff9f-4f31-a2c4-71810b8ce5ec tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:08.717168 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-de874f57-ff9f-4f31-a2c4-71810b8ce5ec tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:08.717614 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-de874f57-ff9f-4f31-a2c4-71810b8ce5ec tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:08.843657 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-de874f57-ff9f-4f31-a2c4-71810b8ce5ec tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:08.851028 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-de874f57-ff9f-4f31-a2c4-71810b8ce5ec tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1548 microversion: 2.1 time: 0.145995 Apr 12 00:38:08.851601 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 543/1110] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:08 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:10.344419 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-32a2d27d-697b-4386-89b9-e5c2ab7e90b1 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a8286da-da02-41ae-83d2-f7c37a25a4ce"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:10.345501 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-32a2d27d-697b-4386-89b9-e5c2ab7e90b1 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:10.351763 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-32a2d27d-697b-4386-89b9-e5c2ab7e90b1 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:10.352211 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-32a2d27d-697b-4386-89b9-e5c2ab7e90b1 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:10.352974 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-32a2d27d-697b-4386-89b9-e5c2ab7e90b1 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:10.353412 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-32a2d27d-697b-4386-89b9-e5c2ab7e90b1 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:10.596940 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-32a2d27d-697b-4386-89b9-e5c2ab7e90b1 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "POST /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256855 Apr 12 00:38:10.597694 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 568/1111] 10.222.0.32 () {60 vars in 1322 bytes} [Tue Apr 12 00:38:10 2022] POST /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:18.115341 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c29d74f6-516c-4db5-9622-5b2dc9b15bdf tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:18.115952 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c29d74f6-516c-4db5-9622-5b2dc9b15bdf tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:18.122112 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c29d74f6-516c-4db5-9622-5b2dc9b15bdf tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:18.123119 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c29d74f6-516c-4db5-9622-5b2dc9b15bdf tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:18.123871 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c29d74f6-516c-4db5-9622-5b2dc9b15bdf tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:18.124303 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c29d74f6-516c-4db5-9622-5b2dc9b15bdf tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:18.248183 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c29d74f6-516c-4db5-9622-5b2dc9b15bdf tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:18.256052 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c29d74f6-516c-4db5-9622-5b2dc9b15bdf tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1594 microversion: 2.1 time: 0.144581 Apr 12 00:38:18.256702 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 544/1112] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:18 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1594 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:19.882841 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-68131669-88d3-4481-a151-1bb061faece8 req-a691528d-1729-426a-9d20-720b95ba5c33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ec626f-1d95-45d9-8293-40d6408a52d2", "tag": "f8104ec7-8594-4188-ae28-392ce2284da2"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:19.891736 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-68131669-88d3-4481-a151-1bb061faece8 req-a691528d-1729-426a-9d20-720b95ba5c33 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:19.892181 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-68131669-88d3-4481-a151-1bb061faece8 req-a691528d-1729-426a-9d20-720b95ba5c33 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:19.903694 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-68131669-88d3-4481-a151-1bb061faece8 req-a691528d-1729-426a-9d20-720b95ba5c33 service nova] Creating event network-changed:f8104ec7-8594-4188-ae28-392ce2284da2 for instance 90ec626f-1d95-45d9-8293-40d6408a52d2 on hv-cinder-83625 Apr 12 00:38:19.909803 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-68131669-88d3-4481-a151-1bb061faece8 req-a691528d-1729-426a-9d20-720b95ba5c33 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031588 Apr 12 00:38:19.910871 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 569/1113] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:20.908381 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-0b888a74-250a-47a3-92ac-ab72a3f19108 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1041762533"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:20.908968 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-0b888a74-250a-47a3-92ac-ab72a3f19108 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:20.915236 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b888a74-250a-47a3-92ac-ab72a3f19108 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:20.915797 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b888a74-250a-47a3-92ac-ab72a3f19108 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:20.916716 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b888a74-250a-47a3-92ac-ab72a3f19108 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:20.917149 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b888a74-250a-47a3-92ac-ab72a3f19108 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:21.043084 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.network.security_group_api [None req-0b888a74-250a-47a3-92ac-ab72a3f19108 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Adding security group bf733550-9bd9-424e-8525-7508fddcb233 to port f8104ec7-8594-4188-ae28-392ce2284da2 Apr 12 00:38:21.376670 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-0b888a74-250a-47a3-92ac-ab72a3f19108 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "POST /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2/action" status: 202 len: 0 microversion: 2.1 time: 0.472876 Apr 12 00:38:21.377532 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 545/1114] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Apr 12 00:38:20 2022] POST /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:38:21.386852 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5d289ab3-98ff-4f15-b953-4e3a7c4babf9 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:21.387690 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5d289ab3-98ff-4f15-b953-4e3a7c4babf9 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:21.396945 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5d289ab3-98ff-4f15-b953-4e3a7c4babf9 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:21.397617 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5d289ab3-98ff-4f15-b953-4e3a7c4babf9 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:21.398974 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5d289ab3-98ff-4f15-b953-4e3a7c4babf9 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:21.399745 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5d289ab3-98ff-4f15-b953-4e3a7c4babf9 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:21.573900 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5d289ab3-98ff-4f15-b953-4e3a7c4babf9 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:21.583243 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5d289ab3-98ff-4f15-b953-4e3a7c4babf9 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1759 microversion: 2.1 time: 0.200916 Apr 12 00:38:21.583821 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 570/1115] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:21 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1759 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:21.926203 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-17e0c4d7-087f-41fb-9a1d-a45384849df2 req-88c55c81-3c36-48e1-b1fb-057696c7d649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ec626f-1d95-45d9-8293-40d6408a52d2", "tag": "f8104ec7-8594-4188-ae28-392ce2284da2"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:21.936482 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-17e0c4d7-087f-41fb-9a1d-a45384849df2 req-88c55c81-3c36-48e1-b1fb-057696c7d649 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:21.936945 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-17e0c4d7-087f-41fb-9a1d-a45384849df2 req-88c55c81-3c36-48e1-b1fb-057696c7d649 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:21.948520 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-17e0c4d7-087f-41fb-9a1d-a45384849df2 req-88c55c81-3c36-48e1-b1fb-057696c7d649 service nova] Creating event network-changed:f8104ec7-8594-4188-ae28-392ce2284da2 for instance 90ec626f-1d95-45d9-8293-40d6408a52d2 on hv-cinder-83625 Apr 12 00:38:21.954839 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-17e0c4d7-087f-41fb-9a1d-a45384849df2 req-88c55c81-3c36-48e1-b1fb-057696c7d649 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032558 Apr 12 00:38:21.955453 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 546/1116] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:32.505262 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f23abca8-d297-45c9-8622-2ccc4a00b0d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:32.505966 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f23abca8-d297-45c9-8622-2ccc4a00b0d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:32.512075 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f23abca8-d297-45c9-8622-2ccc4a00b0d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:32.512530 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f23abca8-d297-45c9-8622-2ccc4a00b0d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:32.513846 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f23abca8-d297-45c9-8622-2ccc4a00b0d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:32.514311 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f23abca8-d297-45c9-8622-2ccc4a00b0d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:32.536777 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f23abca8-d297-45c9-8622-2ccc4a00b0d7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd/ips" status: 200 len: 151 microversion: 2.1 time: 0.035631 Apr 12 00:38:32.537332 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 571/1117] 10.222.0.32 () {58 vars in 1247 bytes} [Tue Apr 12 00:38:32 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:33.865558 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-181631a8-7789-4a21-92d9-7199de00a762 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "815277f6-d746-4ae1-9512-8384f94b215b"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:33.866763 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-181631a8-7789-4a21-92d9-7199de00a762 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:33.873451 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-181631a8-7789-4a21-92d9-7199de00a762 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:33.873906 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-181631a8-7789-4a21-92d9-7199de00a762 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:33.874742 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-181631a8-7789-4a21-92d9-7199de00a762 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:33.875181 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-181631a8-7789-4a21-92d9-7199de00a762 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:34.134805 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-181631a8-7789-4a21-92d9-7199de00a762 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "POST /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273345 Apr 12 00:38:34.135743 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 547/1118] 10.222.0.32 () {60 vars in 1322 bytes} [Tue Apr 12 00:38:33 2022] POST /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:41.605310 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-67a29d37-73c4-48dc-bfa6-c1c63aa9fde6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Action: 'create', calling method: .version_select at 0x7f64e157f9d0>, body: {"keypair": {"name": "tempest-keypair-341800142"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:41.618975 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-67a29d37-73c4-48dc-bfa6-c1c63aa9fde6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:38:41.622673 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-67a29d37-73c4-48dc-bfa6-c1c63aa9fde6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for user 69f5eaf4727f4bbf84ce10a5e07d582e and project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:38:41.711126 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-67a29d37-73c4-48dc-bfa6-c1c63aa9fde6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:38:41.714712 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-67a29d37-73c4-48dc-bfa6-c1c63aa9fde6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for user 69f5eaf4727f4bbf84ce10a5e07d582e and project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:38:41.727682 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-67a29d37-73c4-48dc-bfa6-c1c63aa9fde6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.126167 Apr 12 00:38:41.728273 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 572/1119] 10.222.0.32 () {60 vars in 1157 bytes} [Tue Apr 12 00:38:41 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:43.243803 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e52f0a89-ad8b-4d82-a81f-d7178b625e77 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1842351390", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad6fa16c-9ae9-409b-a431-15655dbe3bc7"}], "security_groups": [{"name": "tempest-securitygroup--302274994"}], "key_name": "tempest-keypair-341800142", "user_data": "}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:43.345855 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.network.neutron [None req-e52f0a89-ad8b-4d82-a81f-d7178b625e77 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] validate_networks() for [('ad6fa16c-9ae9-409b-a431-15655dbe3bc7', None, None, None, None, None)] {{(pid=128487) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:38:43.704457 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-e52f0a89-ad8b-4d82-a81f-d7178b625e77 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Flavor limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:38:43.704891 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-e52f0a89-ad8b-4d82-a81f-d7178b625e77 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Image limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:38:43.705362 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-e52f0a89-ad8b-4d82-a81f-d7178b625e77 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Flavor pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:38:43.705765 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-e52f0a89-ad8b-4d82-a81f-d7178b625e77 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Image pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:38:43.706170 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-e52f0a89-ad8b-4d82-a81f-d7178b625e77 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:38:43.714959 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e52f0a89-ad8b-4d82-a81f-d7178b625e77 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:43.715405 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e52f0a89-ad8b-4d82-a81f-d7178b625e77 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:43.716201 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e52f0a89-ad8b-4d82-a81f-d7178b625e77 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:43.716675 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e52f0a89-ad8b-4d82-a81f-d7178b625e77 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:43.732712 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-e52f0a89-ad8b-4d82-a81f-d7178b625e77 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:38:43.736584 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-e52f0a89-ad8b-4d82-a81f-d7178b625e77 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for user 69f5eaf4727f4bbf84ce10a5e07d582e and project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:38:43.747676 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e52f0a89-ad8b-4d82-a81f-d7178b625e77 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Going to run 1 instances... {{(pid=128487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:38:43.749999 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e52f0a89-ad8b-4d82-a81f-d7178b625e77 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:38:43.797483 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e52f0a89-ad8b-4d82-a81f-d7178b625e77 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.558253 Apr 12 00:38:43.798138 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 548/1120] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:38:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:38:43.808488 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8471a384-4ceb-4e68-8174-6c8880275920 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:43.809330 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8471a384-4ceb-4e68-8174-6c8880275920 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:43.864644 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8471a384-4ceb-4e68-8174-6c8880275920 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:43.872237 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8471a384-4ceb-4e68-8174-6c8880275920 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 200 len: 1241 microversion: 2.1 time: 0.067888 Apr 12 00:38:43.872803 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 573/1121] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:43 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:44.890094 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f2dd20b5-f932-4010-8f13-5dc5ef471ea6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:44.890939 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f2dd20b5-f932-4010-8f13-5dc5ef471ea6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:44.898527 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2dd20b5-f932-4010-8f13-5dc5ef471ea6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:44.899243 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2dd20b5-f932-4010-8f13-5dc5ef471ea6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:44.900015 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2dd20b5-f932-4010-8f13-5dc5ef471ea6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:44.900449 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f2dd20b5-f932-4010-8f13-5dc5ef471ea6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:44.966481 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f2dd20b5-f932-4010-8f13-5dc5ef471ea6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:44.974052 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f2dd20b5-f932-4010-8f13-5dc5ef471ea6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 200 len: 1299 microversion: 2.1 time: 0.088830 Apr 12 00:38:44.974641 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 549/1122] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:44 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:45.997599 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0f58cc74-bb12-4fda-8de1-f0073be41ce0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:46.000224 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0f58cc74-bb12-4fda-8de1-f0073be41ce0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:46.007914 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0f58cc74-bb12-4fda-8de1-f0073be41ce0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:46.008474 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0f58cc74-bb12-4fda-8de1-f0073be41ce0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:46.009325 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0f58cc74-bb12-4fda-8de1-f0073be41ce0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:46.009867 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0f58cc74-bb12-4fda-8de1-f0073be41ce0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:46.148439 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0f58cc74-bb12-4fda-8de1-f0073be41ce0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:46.156077 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0f58cc74-bb12-4fda-8de1-f0073be41ce0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 200 len: 1366 microversion: 2.1 time: 0.167693 Apr 12 00:38:46.156591 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 574/1123] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:45 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:46.199774 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-3129bd38-c9bb-4ee4-9426-b2d91445bbec req-63f5ca6c-bf3c-4603-8a37-98ddc8c7e0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a589bc8-9b32-4820-aa00-e5c764ba1b77", "tag": "a3a93149-14b3-413d-b3d4-f6a40088a349"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:46.211924 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-3129bd38-c9bb-4ee4-9426-b2d91445bbec req-63f5ca6c-bf3c-4603-8a37-98ddc8c7e0c9 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:46.212788 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-3129bd38-c9bb-4ee4-9426-b2d91445bbec req-63f5ca6c-bf3c-4603-8a37-98ddc8c7e0c9 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:46.240463 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-3129bd38-c9bb-4ee4-9426-b2d91445bbec req-63f5ca6c-bf3c-4603-8a37-98ddc8c7e0c9 service nova] Creating event network-changed:a3a93149-14b3-413d-b3d4-f6a40088a349 for instance 8a589bc8-9b32-4820-aa00-e5c764ba1b77 on hv-cinder-83625 Apr 12 00:38:46.248425 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-3129bd38-c9bb-4ee4-9426-b2d91445bbec req-63f5ca6c-bf3c-4603-8a37-98ddc8c7e0c9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052971 Apr 12 00:38:46.249140 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 550/1124] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:47.173369 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8f8c4807-b20f-47f8-8164-8fca2b0c5cd9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:47.173980 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8f8c4807-b20f-47f8-8164-8fca2b0c5cd9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:47.180282 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8f8c4807-b20f-47f8-8164-8fca2b0c5cd9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:47.180731 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8f8c4807-b20f-47f8-8164-8fca2b0c5cd9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:47.181765 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8f8c4807-b20f-47f8-8164-8fca2b0c5cd9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:47.182205 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8f8c4807-b20f-47f8-8164-8fca2b0c5cd9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:47.309242 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-8f8c4807-b20f-47f8-8164-8fca2b0c5cd9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:47.317098 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8f8c4807-b20f-47f8-8164-8fca2b0c5cd9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 200 len: 1366 microversion: 2.1 time: 0.148262 Apr 12 00:38:47.317662 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 575/1125] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:47 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:48.335372 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-88c2b33f-6d45-4178-a863-7a4585727f04 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:48.336064 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-88c2b33f-6d45-4178-a863-7a4585727f04 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:48.343111 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-88c2b33f-6d45-4178-a863-7a4585727f04 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:48.343568 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-88c2b33f-6d45-4178-a863-7a4585727f04 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:48.344371 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-88c2b33f-6d45-4178-a863-7a4585727f04 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:48.344809 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-88c2b33f-6d45-4178-a863-7a4585727f04 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:48.469475 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-88c2b33f-6d45-4178-a863-7a4585727f04 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:48.476687 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-88c2b33f-6d45-4178-a863-7a4585727f04 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 200 len: 1366 microversion: 2.1 time: 0.146065 Apr 12 00:38:48.477260 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 551/1126] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:48 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:49.493465 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-288329e2-bc03-4619-a0b2-25db6ff15f8c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:49.494021 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-288329e2-bc03-4619-a0b2-25db6ff15f8c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:49.500846 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-288329e2-bc03-4619-a0b2-25db6ff15f8c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:49.501289 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-288329e2-bc03-4619-a0b2-25db6ff15f8c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:49.502036 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-288329e2-bc03-4619-a0b2-25db6ff15f8c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:49.502492 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-288329e2-bc03-4619-a0b2-25db6ff15f8c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:49.628293 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-288329e2-bc03-4619-a0b2-25db6ff15f8c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:49.635627 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-288329e2-bc03-4619-a0b2-25db6ff15f8c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 200 len: 1366 microversion: 2.1 time: 0.146131 Apr 12 00:38:49.636181 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 576/1127] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:49 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:50.653045 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-dcbd1b24-2613-493d-ad10-8f7fc2a9ff5e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:50.653595 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-dcbd1b24-2613-493d-ad10-8f7fc2a9ff5e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:50.660023 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dcbd1b24-2613-493d-ad10-8f7fc2a9ff5e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:50.660474 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dcbd1b24-2613-493d-ad10-8f7fc2a9ff5e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:50.661239 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dcbd1b24-2613-493d-ad10-8f7fc2a9ff5e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:50.661674 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dcbd1b24-2613-493d-ad10-8f7fc2a9ff5e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:50.795605 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-dcbd1b24-2613-493d-ad10-8f7fc2a9ff5e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:50.803050 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-dcbd1b24-2613-493d-ad10-8f7fc2a9ff5e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 200 len: 1366 microversion: 2.1 time: 0.153945 Apr 12 00:38:50.803649 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 552/1128] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:50 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:51.820303 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-74e278a7-4fa3-46cb-b6f9-edfda0cd6d51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:51.820966 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-74e278a7-4fa3-46cb-b6f9-edfda0cd6d51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:51.827803 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-74e278a7-4fa3-46cb-b6f9-edfda0cd6d51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:51.828250 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-74e278a7-4fa3-46cb-b6f9-edfda0cd6d51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:51.829001 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-74e278a7-4fa3-46cb-b6f9-edfda0cd6d51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:51.829506 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-74e278a7-4fa3-46cb-b6f9-edfda0cd6d51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:51.954764 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-74e278a7-4fa3-46cb-b6f9-edfda0cd6d51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:51.963266 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-74e278a7-4fa3-46cb-b6f9-edfda0cd6d51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 200 len: 1366 microversion: 2.1 time: 0.146760 Apr 12 00:38:51.963833 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 577/1129] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:51 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:52.513644 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-b0310204-7cbc-4f52-bb75-e1d028fa98fd req-5e9112d5-398b-4922-913f-0b61341a0bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a589bc8-9b32-4820-aa00-e5c764ba1b77", "name": "network-vif-plugged", "status": "completed", "tag": "a3a93149-14b3-413d-b3d4-f6a40088a349"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:52.522857 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-b0310204-7cbc-4f52-bb75-e1d028fa98fd req-5e9112d5-398b-4922-913f-0b61341a0bd3 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:52.523349 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-b0310204-7cbc-4f52-bb75-e1d028fa98fd req-5e9112d5-398b-4922-913f-0b61341a0bd3 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:52.535410 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-b0310204-7cbc-4f52-bb75-e1d028fa98fd req-5e9112d5-398b-4922-913f-0b61341a0bd3 service nova] Creating event network-vif-plugged:a3a93149-14b3-413d-b3d4-f6a40088a349 for instance 8a589bc8-9b32-4820-aa00-e5c764ba1b77 on hv-cinder-83625 Apr 12 00:38:52.540665 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-b0310204-7cbc-4f52-bb75-e1d028fa98fd req-5e9112d5-398b-4922-913f-0b61341a0bd3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030667 Apr 12 00:38:52.541272 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 553/1130] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:38:52.980622 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-fff2d5a5-f027-4398-ab64-a60958d054ee tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:52.981221 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-fff2d5a5-f027-4398-ab64-a60958d054ee tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:52.987493 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fff2d5a5-f027-4398-ab64-a60958d054ee tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:52.987945 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fff2d5a5-f027-4398-ab64-a60958d054ee tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:52.988707 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fff2d5a5-f027-4398-ab64-a60958d054ee tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:52.989146 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fff2d5a5-f027-4398-ab64-a60958d054ee tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:53.116598 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-fff2d5a5-f027-4398-ab64-a60958d054ee tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:53.124868 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-fff2d5a5-f027-4398-ab64-a60958d054ee tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 200 len: 1366 microversion: 2.1 time: 0.147999 Apr 12 00:38:53.125485 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 578/1131] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:52 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:54.143147 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-695787de-10cd-48de-bfaf-b2e41c45a1fd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:54.144621 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-695787de-10cd-48de-bfaf-b2e41c45a1fd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:54.151218 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-695787de-10cd-48de-bfaf-b2e41c45a1fd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:54.151678 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-695787de-10cd-48de-bfaf-b2e41c45a1fd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:54.152453 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-695787de-10cd-48de-bfaf-b2e41c45a1fd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:54.152891 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-695787de-10cd-48de-bfaf-b2e41c45a1fd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:54.302589 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-695787de-10cd-48de-bfaf-b2e41c45a1fd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:54.310353 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-695787de-10cd-48de-bfaf-b2e41c45a1fd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 200 len: 1366 microversion: 2.1 time: 0.172191 Apr 12 00:38:54.310921 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 554/1132] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:54 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:55.328888 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5e0e5d1d-745e-4e31-86c4-d7e32d988877 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:55.329734 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5e0e5d1d-745e-4e31-86c4-d7e32d988877 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:55.336358 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5e0e5d1d-745e-4e31-86c4-d7e32d988877 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:55.336833 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5e0e5d1d-745e-4e31-86c4-d7e32d988877 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:55.337584 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5e0e5d1d-745e-4e31-86c4-d7e32d988877 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:55.338011 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5e0e5d1d-745e-4e31-86c4-d7e32d988877 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:55.462348 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-5e0e5d1d-745e-4e31-86c4-d7e32d988877 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:38:55.469990 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5e0e5d1d-745e-4e31-86c4-d7e32d988877 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 200 len: 1557 microversion: 2.1 time: 0.145570 Apr 12 00:38:55.470585 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 579/1133] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:38:55 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:55.486521 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-515557d9-e59a-4c91-9ee9-cc4b5ffbf56e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:55.487093 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-515557d9-e59a-4c91-9ee9-cc4b5ffbf56e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:38:55.493308 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-515557d9-e59a-4c91-9ee9-cc4b5ffbf56e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:55.493844 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-515557d9-e59a-4c91-9ee9-cc4b5ffbf56e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:55.494754 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-515557d9-e59a-4c91-9ee9-cc4b5ffbf56e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:55.495251 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-515557d9-e59a-4c91-9ee9-cc4b5ffbf56e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:55.571654 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-515557d9-e59a-4c91-9ee9-cc4b5ffbf56e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088901 Apr 12 00:38:55.572244 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 555/1134] 10.222.0.32 () {58 vars in 1274 bytes} [Tue Apr 12 00:38:55 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:56.775289 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-d85cfeff-03a3-4894-846c-3bbf5a3ceb2a req-98ec438e-4042-4ac8-88da-01870f49cc05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a589bc8-9b32-4820-aa00-e5c764ba1b77", "tag": "a3a93149-14b3-413d-b3d4-f6a40088a349"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:56.784192 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-d85cfeff-03a3-4894-846c-3bbf5a3ceb2a req-98ec438e-4042-4ac8-88da-01870f49cc05 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:38:56.784636 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-d85cfeff-03a3-4894-846c-3bbf5a3ceb2a req-98ec438e-4042-4ac8-88da-01870f49cc05 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:38:56.796032 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-d85cfeff-03a3-4894-846c-3bbf5a3ceb2a req-98ec438e-4042-4ac8-88da-01870f49cc05 service nova] Creating event network-changed:a3a93149-14b3-413d-b3d4-f6a40088a349 for instance 8a589bc8-9b32-4820-aa00-e5c764ba1b77 on hv-cinder-83625 Apr 12 00:38:56.800961 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-d85cfeff-03a3-4894-846c-3bbf5a3ceb2a req-98ec438e-4042-4ac8-88da-01870f49cc05 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029396 Apr 12 00:38:56.801558 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 580/1135] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:04.105800 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-ab699be4-ff0e-48a9-ad79-3ecbf4c13d6d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:04.106393 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-ab699be4-ff0e-48a9-ad79-3ecbf4c13d6d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:04.107833 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-e9231187-8f64-4827-8fd4-13a63b035dd5 req-8fbb612a-bc14-462c-8101-fc35dbf309d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f92fc1-03bb-4d20-959e-fb9cd283f51a", "tag": "6de8e31e-e087-40aa-a319-0647d34795ca"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:04.112523 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ab699be4-ff0e-48a9-ad79-3ecbf4c13d6d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:04.113155 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ab699be4-ff0e-48a9-ad79-3ecbf4c13d6d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:04.114173 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ab699be4-ff0e-48a9-ad79-3ecbf4c13d6d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:04.114817 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-ab699be4-ff0e-48a9-ad79-3ecbf4c13d6d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:04.117078 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-e9231187-8f64-4827-8fd4-13a63b035dd5 req-8fbb612a-bc14-462c-8101-fc35dbf309d1 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:04.117587 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-e9231187-8f64-4827-8fd4-13a63b035dd5 req-8fbb612a-bc14-462c-8101-fc35dbf309d1 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:04.128870 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-e9231187-8f64-4827-8fd4-13a63b035dd5 req-8fbb612a-bc14-462c-8101-fc35dbf309d1 service nova] Creating event network-changed:6de8e31e-e087-40aa-a319-0647d34795ca for instance b7f92fc1-03bb-4d20-959e-fb9cd283f51a on hv-cinder-83625 Apr 12 00:39:04.135529 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-e9231187-8f64-4827-8fd4-13a63b035dd5 req-8fbb612a-bc14-462c-8101-fc35dbf309d1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031357 Apr 12 00:39:04.138567 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 581/1136] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:39:04.141633 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-ab699be4-ff0e-48a9-ad79-3ecbf4c13d6d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Going to try to terminate instance {{(pid=128487) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:39:04.220511 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-ab699be4-ff0e-48a9-ad79-3ecbf4c13d6d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 204 len: 0 microversion: 2.1 time: 0.118620 Apr 12 00:39:04.221905 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 556/1137] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:39:04 2022] DELETE /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:39:04.232237 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0f39f258-f39d-418b-9244-b35aa6381ac7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:04.233314 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0f39f258-f39d-418b-9244-b35aa6381ac7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:04.239465 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0f39f258-f39d-418b-9244-b35aa6381ac7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:04.240139 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0f39f258-f39d-418b-9244-b35aa6381ac7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:04.240702 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0f39f258-f39d-418b-9244-b35aa6381ac7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:04.241230 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0f39f258-f39d-418b-9244-b35aa6381ac7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:04.373761 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-0f39f258-f39d-418b-9244-b35aa6381ac7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:04.381322 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0f39f258-f39d-418b-9244-b35aa6381ac7 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1575 microversion: 2.1 time: 0.153885 Apr 12 00:39:04.382032 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 582/1138] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:04 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:05.400997 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c8e4a454-c9fb-4c1d-bff6-fd2035747321 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:05.401606 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c8e4a454-c9fb-4c1d-bff6-fd2035747321 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:05.409346 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c8e4a454-c9fb-4c1d-bff6-fd2035747321 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:05.409797 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c8e4a454-c9fb-4c1d-bff6-fd2035747321 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:05.410587 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c8e4a454-c9fb-4c1d-bff6-fd2035747321 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:05.411028 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c8e4a454-c9fb-4c1d-bff6-fd2035747321 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:05.618057 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c8e4a454-c9fb-4c1d-bff6-fd2035747321 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:05.625369 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c8e4a454-c9fb-4c1d-bff6-fd2035747321 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1575 microversion: 2.1 time: 0.228689 Apr 12 00:39:05.625944 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 557/1139] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:05 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1575 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:06.468997 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:39:06.469574 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: Tue Apr 12 00:39:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 00:39:06.642792 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-31cd721f-c78e-40ea-a4d2-b869a075e275 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:06.643394 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-31cd721f-c78e-40ea-a4d2-b869a075e275 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:06.650538 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-31cd721f-c78e-40ea-a4d2-b869a075e275 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:06.650996 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-31cd721f-c78e-40ea-a4d2-b869a075e275 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:06.651772 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-31cd721f-c78e-40ea-a4d2-b869a075e275 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:06.652212 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-31cd721f-c78e-40ea-a4d2-b869a075e275 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:06.720764 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-31cd721f-c78e-40ea-a4d2-b869a075e275 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:06.728088 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-31cd721f-c78e-40ea-a4d2-b869a075e275 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 200 len: 1389 microversion: 2.1 time: 0.089511 Apr 12 00:39:06.728657 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 583/1140] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:06 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:06.750729 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-e667bfe9-f47a-4618-a9e0-a40d528ac40f req-e6029eb8-411a-40d8-9c09-5837b08c66ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f92fc1-03bb-4d20-959e-fb9cd283f51a", "name": "network-vif-deleted", "tag": "6de8e31e-e087-40aa-a319-0647d34795ca"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:06.760025 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-e667bfe9-f47a-4618-a9e0-a40d528ac40f req-e6029eb8-411a-40d8-9c09-5837b08c66ed service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:06.760463 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-e667bfe9-f47a-4618-a9e0-a40d528ac40f req-e6029eb8-411a-40d8-9c09-5837b08c66ed service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:06.772057 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-e667bfe9-f47a-4618-a9e0-a40d528ac40f req-e6029eb8-411a-40d8-9c09-5837b08c66ed service nova] Creating event network-vif-deleted:6de8e31e-e087-40aa-a319-0647d34795ca for instance b7f92fc1-03bb-4d20-959e-fb9cd283f51a on hv-cinder-83625 Apr 12 00:39:06.776999 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-e667bfe9-f47a-4618-a9e0-a40d528ac40f req-e6029eb8-411a-40d8-9c09-5837b08c66ed service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029781 Apr 12 00:39:06.777679 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 558/1141] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:07.745047 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-23f203de-7ddb-4b22-99c0-5a5675da5832 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:07.745823 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-23f203de-7ddb-4b22-99c0-5a5675da5832 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: b7f92fc1-03bb-4d20-959e-fb9cd283f51a] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:07.752974 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-23f203de-7ddb-4b22-99c0-5a5675da5832 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:07.753357 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-23f203de-7ddb-4b22-99c0-5a5675da5832 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:07.754115 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-23f203de-7ddb-4b22-99c0-5a5675da5832 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:07.754610 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-23f203de-7ddb-4b22-99c0-5a5675da5832 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:07.768215 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-23f203de-7ddb-4b22-99c0-5a5675da5832 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] HTTP exception thrown: Instance b7f92fc1-03bb-4d20-959e-fb9cd283f51a could not be found. Apr 12 00:39:07.768787 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-23f203de-7ddb-4b22-99c0-5a5675da5832 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Returning 404 to user: Instance b7f92fc1-03bb-4d20-959e-fb9cd283f51a could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:39:07.769587 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-23f203de-7ddb-4b22-99c0-5a5675da5832 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a" status: 404 len: 111 microversion: 2.1 time: 0.028500 Apr 12 00:39:07.770106 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 584/1142] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:07 2022] GET /compute/v2.1/servers/b7f92fc1-03bb-4d20-959e-fb9cd283f51a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 00:39:10.811090 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3d57aadc-96af-4a17-9674-0dcec8adea27 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:10.811802 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3d57aadc-96af-4a17-9674-0dcec8adea27 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:10.812826 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-d3afa839-62ad-4ffd-b4af-dd3b1a7f7ccf req-d150c74d-8c2b-4eda-9a73-badfca3ba62f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a3357fa-5beb-40ae-ba19-95e893acd4b8", "tag": "eacce356-7ace-426f-a907-2db9bedc490d"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:10.818133 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3d57aadc-96af-4a17-9674-0dcec8adea27 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:10.818626 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3d57aadc-96af-4a17-9674-0dcec8adea27 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:10.819389 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3d57aadc-96af-4a17-9674-0dcec8adea27 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:10.819823 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3d57aadc-96af-4a17-9674-0dcec8adea27 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:10.821729 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-d3afa839-62ad-4ffd-b4af-dd3b1a7f7ccf req-d150c74d-8c2b-4eda-9a73-badfca3ba62f service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:10.822287 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-d3afa839-62ad-4ffd-b4af-dd3b1a7f7ccf req-d150c74d-8c2b-4eda-9a73-badfca3ba62f service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:10.835144 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-d3afa839-62ad-4ffd-b4af-dd3b1a7f7ccf req-d150c74d-8c2b-4eda-9a73-badfca3ba62f service nova] Creating event network-changed:eacce356-7ace-426f-a907-2db9bedc490d for instance 4a3357fa-5beb-40ae-ba19-95e893acd4b8 on hv-cinder-83625 Apr 12 00:39:10.840412 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-d3afa839-62ad-4ffd-b4af-dd3b1a7f7ccf req-d150c74d-8c2b-4eda-9a73-badfca3ba62f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031868 Apr 12 00:39:10.844253 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 585/1143] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:10.846810 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3d57aadc-96af-4a17-9674-0dcec8adea27 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Going to try to terminate instance {{(pid=128487) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:39:10.933372 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3d57aadc-96af-4a17-9674-0dcec8adea27 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 204 len: 0 microversion: 2.1 time: 0.127065 Apr 12 00:39:10.937975 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 559/1144] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:39:10 2022] DELETE /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:39:10.943716 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2c2ed57a-3f26-46e5-b4ab-06c4933a3257 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:10.944734 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-2c2ed57a-3f26-46e5-b4ab-06c4933a3257 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:10.951596 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2c2ed57a-3f26-46e5-b4ab-06c4933a3257 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:10.952387 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2c2ed57a-3f26-46e5-b4ab-06c4933a3257 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:10.953424 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2c2ed57a-3f26-46e5-b4ab-06c4933a3257 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:10.954110 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2c2ed57a-3f26-46e5-b4ab-06c4933a3257 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:11.089839 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2c2ed57a-3f26-46e5-b4ab-06c4933a3257 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:11.097205 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2c2ed57a-3f26-46e5-b4ab-06c4933a3257 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1577 microversion: 2.1 time: 0.157776 Apr 12 00:39:11.097782 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 586/1145] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:10 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:12.115289 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2b83aed4-5c5c-4183-b493-9c65c88b5362 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:12.115985 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2b83aed4-5c5c-4183-b493-9c65c88b5362 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:12.122155 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2b83aed4-5c5c-4183-b493-9c65c88b5362 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:12.122636 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2b83aed4-5c5c-4183-b493-9c65c88b5362 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:12.123394 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2b83aed4-5c5c-4183-b493-9c65c88b5362 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:12.123831 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2b83aed4-5c5c-4183-b493-9c65c88b5362 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:12.303999 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2b83aed4-5c5c-4183-b493-9c65c88b5362 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:12.311252 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2b83aed4-5c5c-4183-b493-9c65c88b5362 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1577 microversion: 2.1 time: 0.200164 Apr 12 00:39:12.311827 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 560/1146] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:12 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1577 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:13.069846 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-5e3fc0d4-ea36-4d1c-af6f-050216d9ab39 req-387776d8-ff02-4210-93d2-4fe493969900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a3357fa-5beb-40ae-ba19-95e893acd4b8", "name": "network-vif-deleted", "tag": "eacce356-7ace-426f-a907-2db9bedc490d"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:13.079472 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-5e3fc0d4-ea36-4d1c-af6f-050216d9ab39 req-387776d8-ff02-4210-93d2-4fe493969900 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:13.079918 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-5e3fc0d4-ea36-4d1c-af6f-050216d9ab39 req-387776d8-ff02-4210-93d2-4fe493969900 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:13.091267 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-5e3fc0d4-ea36-4d1c-af6f-050216d9ab39 req-387776d8-ff02-4210-93d2-4fe493969900 service nova] Creating event network-vif-deleted:eacce356-7ace-426f-a907-2db9bedc490d for instance 4a3357fa-5beb-40ae-ba19-95e893acd4b8 on hv-cinder-83625 Apr 12 00:39:13.096002 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-5e3fc0d4-ea36-4d1c-af6f-050216d9ab39 req-387776d8-ff02-4210-93d2-4fe493969900 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029851 Apr 12 00:39:13.096519 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 587/1147] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:13.328554 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-45091f21-d584-401e-a28b-18f05d7a4155 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:13.329128 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-45091f21-d584-401e-a28b-18f05d7a4155 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:13.335525 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-45091f21-d584-401e-a28b-18f05d7a4155 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:13.335910 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-45091f21-d584-401e-a28b-18f05d7a4155 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:13.336702 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-45091f21-d584-401e-a28b-18f05d7a4155 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:13.337124 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-45091f21-d584-401e-a28b-18f05d7a4155 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:13.401740 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-45091f21-d584-401e-a28b-18f05d7a4155 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1d212dad5347a888832a779beadece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:13.409691 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-45091f21-d584-401e-a28b-18f05d7a4155 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 200 len: 1225 microversion: 2.1 time: 0.085506 Apr 12 00:39:13.410492 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 561/1148] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:13 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:14.427998 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5b6a9700-9942-4a23-befa-680c2161ff1d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:14.428692 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5b6a9700-9942-4a23-befa-680c2161ff1d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: 4a3357fa-5beb-40ae-ba19-95e893acd4b8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:14.435348 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5b6a9700-9942-4a23-befa-680c2161ff1d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:14.435792 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5b6a9700-9942-4a23-befa-680c2161ff1d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:14.436552 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5b6a9700-9942-4a23-befa-680c2161ff1d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:14.436980 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5b6a9700-9942-4a23-befa-680c2161ff1d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:14.450430 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-5b6a9700-9942-4a23-befa-680c2161ff1d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] HTTP exception thrown: Instance 4a3357fa-5beb-40ae-ba19-95e893acd4b8 could not be found. Apr 12 00:39:14.451008 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5b6a9700-9942-4a23-befa-680c2161ff1d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Returning 404 to user: Instance 4a3357fa-5beb-40ae-ba19-95e893acd4b8 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:39:14.451810 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5b6a9700-9942-4a23-befa-680c2161ff1d tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8" status: 404 len: 111 microversion: 2.1 time: 0.028438 Apr 12 00:39:14.452334 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 588/1149] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:14 2022] GET /compute/v2.1/servers/4a3357fa-5beb-40ae-ba19-95e893acd4b8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:39:14.891649 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-aa8835e9-cc28-48ae-a6cd-6698e2cda5d9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:14.892173 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-aa8835e9-cc28-48ae-a6cd-6698e2cda5d9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:14.898315 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-aa8835e9-cc28-48ae-a6cd-6698e2cda5d9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:14.898762 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-aa8835e9-cc28-48ae-a6cd-6698e2cda5d9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:14.899513 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-aa8835e9-cc28-48ae-a6cd-6698e2cda5d9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:14.899945 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-aa8835e9-cc28-48ae-a6cd-6698e2cda5d9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:14.913422 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-aa8835e9-cc28-48ae-a6cd-6698e2cda5d9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] HTTP exception thrown: Instance e46194d7-3e05-4313-b0ca-4ec9cee517f8 could not be found. Apr 12 00:39:14.914048 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-aa8835e9-cc28-48ae-a6cd-6698e2cda5d9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Returning 404 to user: Instance e46194d7-3e05-4313-b0ca-4ec9cee517f8 could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:39:14.914931 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-aa8835e9-cc28-48ae-a6cd-6698e2cda5d9 tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 404 len: 111 microversion: 2.1 time: 0.027441 Apr 12 00:39:14.915467 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 562/1150] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:39:14 2022] DELETE /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:39:14.923720 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-62282900-31a4-48f5-ae3d-259975b3f56a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:14.924355 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-62282900-31a4-48f5-ae3d-259975b3f56a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] [instance: e46194d7-3e05-4313-b0ca-4ec9cee517f8] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:14.930084 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-62282900-31a4-48f5-ae3d-259975b3f56a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:14.930549 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-62282900-31a4-48f5-ae3d-259975b3f56a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:14.931294 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-62282900-31a4-48f5-ae3d-259975b3f56a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:14.931721 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-62282900-31a4-48f5-ae3d-259975b3f56a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:14.944909 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-62282900-31a4-48f5-ae3d-259975b3f56a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] HTTP exception thrown: Instance e46194d7-3e05-4313-b0ca-4ec9cee517f8 could not be found. Apr 12 00:39:14.945477 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-62282900-31a4-48f5-ae3d-259975b3f56a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Returning 404 to user: Instance e46194d7-3e05-4313-b0ca-4ec9cee517f8 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:39:14.946285 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-62282900-31a4-48f5-ae3d-259975b3f56a tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8" status: 404 len: 111 microversion: 2.1 time: 0.026551 Apr 12 00:39:14.946791 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 589/1151] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:14 2022] GET /compute/v2.1/servers/e46194d7-3e05-4313-b0ca-4ec9cee517f8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:39:16.225497 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-002e8428-2df0-4d4c-9b9c-a74fab22f68b tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] Calling method '.version_select at 0x7f64e11b9700>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:16.259027 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-002e8428-2df0-4d4c-9b9c-a74fab22f68b tempest-TestVolumeBootPattern-2050493480 tempest-TestVolumeBootPattern-2050493480-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-989695835" status: 202 len: 0 microversion: 2.1 time: 0.038316 Apr 12 00:39:16.259798 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 563/1152] 10.222.0.32 () {58 vars in 1259 bytes} [Tue Apr 12 00:39:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-989695835 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:39:22.161099 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-aa20bec9-b658-429c-aeea-24db0014f9d3 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:22.162063 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-aa20bec9-b658-429c-aeea-24db0014f9d3 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:22.171099 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-aa20bec9-b658-429c-aeea-24db0014f9d3 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:22.171497 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-aa20bec9-b658-429c-aeea-24db0014f9d3 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:22.172263 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-aa20bec9-b658-429c-aeea-24db0014f9d3 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:22.172692 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-aa20bec9-b658-429c-aeea-24db0014f9d3 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:22.267859 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-aa20bec9-b658-429c-aeea-24db0014f9d3 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "POST /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2/action" status: 202 len: 0 microversion: 2.1 time: 0.110012 Apr 12 00:39:22.271664 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 590/1153] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Apr 12 00:39:22 2022] POST /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:39:22.282331 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2ca80ecf-c0d1-4e14-ad6e-a02d00d6dfcb tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:22.282880 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2ca80ecf-c0d1-4e14-ad6e-a02d00d6dfcb tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:22.294982 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2ca80ecf-c0d1-4e14-ad6e-a02d00d6dfcb tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:22.295532 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2ca80ecf-c0d1-4e14-ad6e-a02d00d6dfcb tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:22.296396 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2ca80ecf-c0d1-4e14-ad6e-a02d00d6dfcb tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:22.296902 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2ca80ecf-c0d1-4e14-ad6e-a02d00d6dfcb tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:22.672072 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2ca80ecf-c0d1-4e14-ad6e-a02d00d6dfcb tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:22.680031 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2ca80ecf-c0d1-4e14-ad6e-a02d00d6dfcb tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1751 microversion: 2.1 time: 0.406124 Apr 12 00:39:22.680676 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 564/1154] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:22 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1751 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:23.698047 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2e871dc7-0272-45cc-8c2c-ca0fffbb67c9 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:23.698990 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-2e871dc7-0272-45cc-8c2c-ca0fffbb67c9 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:23.705423 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2e871dc7-0272-45cc-8c2c-ca0fffbb67c9 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:23.705943 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2e871dc7-0272-45cc-8c2c-ca0fffbb67c9 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:23.706822 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2e871dc7-0272-45cc-8c2c-ca0fffbb67c9 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:23.707327 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2e871dc7-0272-45cc-8c2c-ca0fffbb67c9 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:23.885198 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2e871dc7-0272-45cc-8c2c-ca0fffbb67c9 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:23.894566 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2e871dc7-0272-45cc-8c2c-ca0fffbb67c9 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1756 microversion: 2.1 time: 0.201271 Apr 12 00:39:23.895089 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 591/1155] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:23 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:24.911673 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-cfe4dbc6-fd45-4277-8950-09bcfa463822 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:24.912280 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-cfe4dbc6-fd45-4277-8950-09bcfa463822 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:24.918573 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cfe4dbc6-fd45-4277-8950-09bcfa463822 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:24.919064 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cfe4dbc6-fd45-4277-8950-09bcfa463822 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:24.919761 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cfe4dbc6-fd45-4277-8950-09bcfa463822 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:24.920188 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cfe4dbc6-fd45-4277-8950-09bcfa463822 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:25.056437 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-cfe4dbc6-fd45-4277-8950-09bcfa463822 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:25.064764 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-cfe4dbc6-fd45-4277-8950-09bcfa463822 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1756 microversion: 2.1 time: 0.156886 Apr 12 00:39:25.065322 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 565/1156] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:24 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:26.080808 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ff965219-1054-4065-b15f-30f365daacef tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:26.081425 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ff965219-1054-4065-b15f-30f365daacef tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:26.087752 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ff965219-1054-4065-b15f-30f365daacef tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:26.088203 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ff965219-1054-4065-b15f-30f365daacef tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:26.088973 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ff965219-1054-4065-b15f-30f365daacef tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:26.089409 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ff965219-1054-4065-b15f-30f365daacef tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:26.227134 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ff965219-1054-4065-b15f-30f365daacef tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:26.235370 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ff965219-1054-4065-b15f-30f365daacef tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1756 microversion: 2.1 time: 0.158432 Apr 12 00:39:26.235931 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 592/1157] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:26 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:27.251329 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d0a817b4-85b3-4c83-910a-6ad838aa4ffc tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:27.251935 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d0a817b4-85b3-4c83-910a-6ad838aa4ffc tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:27.258107 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d0a817b4-85b3-4c83-910a-6ad838aa4ffc tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:27.258578 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d0a817b4-85b3-4c83-910a-6ad838aa4ffc tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:27.259322 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d0a817b4-85b3-4c83-910a-6ad838aa4ffc tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:27.259750 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d0a817b4-85b3-4c83-910a-6ad838aa4ffc tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:27.402232 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d0a817b4-85b3-4c83-910a-6ad838aa4ffc tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:27.410541 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d0a817b4-85b3-4c83-910a-6ad838aa4ffc tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1756 microversion: 2.1 time: 0.163107 Apr 12 00:39:27.411104 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 566/1158] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:27 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:39:28.427565 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-100ae8ec-24f5-4f55-bdb3-72db1be888ea tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:28.428189 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-100ae8ec-24f5-4f55-bdb3-72db1be888ea tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:28.434651 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-100ae8ec-24f5-4f55-bdb3-72db1be888ea tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:28.435107 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-100ae8ec-24f5-4f55-bdb3-72db1be888ea tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:28.435867 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-100ae8ec-24f5-4f55-bdb3-72db1be888ea tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:28.436305 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-100ae8ec-24f5-4f55-bdb3-72db1be888ea tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:28.573387 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-100ae8ec-24f5-4f55-bdb3-72db1be888ea tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:28.581100 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-100ae8ec-24f5-4f55-bdb3-72db1be888ea tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1756 microversion: 2.1 time: 0.157508 Apr 12 00:39:28.581665 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 593/1159] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:28 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:29.599484 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-6b7c3304-6173-481b-9412-bbd51e828549 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:29.600089 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-6b7c3304-6173-481b-9412-bbd51e828549 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:29.606988 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6b7c3304-6173-481b-9412-bbd51e828549 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:29.607381 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6b7c3304-6173-481b-9412-bbd51e828549 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:29.608138 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6b7c3304-6173-481b-9412-bbd51e828549 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:29.608571 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-6b7c3304-6173-481b-9412-bbd51e828549 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:29.744816 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-6b7c3304-6173-481b-9412-bbd51e828549 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:29.752560 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-6b7c3304-6173-481b-9412-bbd51e828549 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1756 microversion: 2.1 time: 0.156866 Apr 12 00:39:29.753130 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 567/1160] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:29 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:30.769699 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-a81ad7d5-a54d-4821-bcdc-973cbc10710e tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:30.770338 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-a81ad7d5-a54d-4821-bcdc-973cbc10710e tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:30.776496 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a81ad7d5-a54d-4821-bcdc-973cbc10710e tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:30.776938 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a81ad7d5-a54d-4821-bcdc-973cbc10710e tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:30.778204 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a81ad7d5-a54d-4821-bcdc-973cbc10710e tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:30.778656 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-a81ad7d5-a54d-4821-bcdc-973cbc10710e tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:30.914975 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-a81ad7d5-a54d-4821-bcdc-973cbc10710e tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:30.923247 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-a81ad7d5-a54d-4821-bcdc-973cbc10710e tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1756 microversion: 2.1 time: 0.157311 Apr 12 00:39:30.923747 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 594/1161] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:30 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:31.940281 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3b332302-902c-42d0-8f26-b5107cc4b20a tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:31.940931 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3b332302-902c-42d0-8f26-b5107cc4b20a tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:31.947271 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3b332302-902c-42d0-8f26-b5107cc4b20a tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:31.947726 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3b332302-902c-42d0-8f26-b5107cc4b20a tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:31.948496 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3b332302-902c-42d0-8f26-b5107cc4b20a tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:31.948931 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3b332302-902c-42d0-8f26-b5107cc4b20a tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:32.085546 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-3b332302-902c-42d0-8f26-b5107cc4b20a tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:32.094182 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3b332302-902c-42d0-8f26-b5107cc4b20a tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1756 microversion: 2.1 time: 0.157807 Apr 12 00:39:32.094786 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 568/1162] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:31 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:33.111195 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3ad579b9-caca-4e9a-b9e6-d63b01b42b91 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:33.111815 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3ad579b9-caca-4e9a-b9e6-d63b01b42b91 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:33.118229 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3ad579b9-caca-4e9a-b9e6-d63b01b42b91 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:33.118741 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3ad579b9-caca-4e9a-b9e6-d63b01b42b91 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:33.119505 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3ad579b9-caca-4e9a-b9e6-d63b01b42b91 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:33.119938 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3ad579b9-caca-4e9a-b9e6-d63b01b42b91 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:33.254991 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3ad579b9-caca-4e9a-b9e6-d63b01b42b91 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:33.263348 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3ad579b9-caca-4e9a-b9e6-d63b01b42b91 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1756 microversion: 2.1 time: 0.156039 Apr 12 00:39:33.263915 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 595/1163] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:33 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1756 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:34.280361 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c105b115-1d11-449c-9498-174691cf34b5 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:34.280996 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c105b115-1d11-449c-9498-174691cf34b5 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:39:34.287326 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c105b115-1d11-449c-9498-174691cf34b5 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:34.287740 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c105b115-1d11-449c-9498-174691cf34b5 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:34.288494 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c105b115-1d11-449c-9498-174691cf34b5 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:39:34.288919 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-c105b115-1d11-449c-9498-174691cf34b5 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:39:34.428535 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c105b115-1d11-449c-9498-174691cf34b5 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:39:34.436847 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c105b115-1d11-449c-9498-174691cf34b5 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1759 microversion: 2.1 time: 0.161008 Apr 12 00:39:34.437607 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 569/1164] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:39:34 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1759 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:11.808818 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9575ce8d-6034-4569-9ee3-9ce84065ce2e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:11.809406 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9575ce8d-6034-4569-9ee3-9ce84065ce2e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:11.816240 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9575ce8d-6034-4569-9ee3-9ce84065ce2e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:11.816240 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9575ce8d-6034-4569-9ee3-9ce84065ce2e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:11.816478 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9575ce8d-6034-4569-9ee3-9ce84065ce2e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:11.816866 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9575ce8d-6034-4569-9ee3-9ce84065ce2e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:11.839509 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9575ce8d-6034-4569-9ee3-9ce84065ce2e tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77/ips" status: 200 len: 150 microversion: 2.1 time: 0.034782 Apr 12 00:40:11.840050 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 596/1165] 10.222.0.32 () {58 vars in 1247 bytes} [Tue Apr 12 00:40:11 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:11.850342 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-258f7c26-b231-4ec4-82da-90e9443c7354 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "815277f6-d746-4ae1-9512-8384f94b215b"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:11.851425 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-258f7c26-b231-4ec4-82da-90e9443c7354 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:11.857395 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-258f7c26-b231-4ec4-82da-90e9443c7354 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:11.857821 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-258f7c26-b231-4ec4-82da-90e9443c7354 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:11.858598 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-258f7c26-b231-4ec4-82da-90e9443c7354 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:11.859031 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-258f7c26-b231-4ec4-82da-90e9443c7354 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:11.935720 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-258f7c26-b231-4ec4-82da-90e9443c7354 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] HTTP exception thrown: Invalid volume: volume 815277f6-d746-4ae1-9512-8384f94b215b is already attached to instances: ca8227d3-6b1f-4d92-90c7-41de2b3054bd Apr 12 00:40:11.936340 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-258f7c26-b231-4ec4-82da-90e9443c7354 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Returning 400 to user: Invalid volume: volume 815277f6-d746-4ae1-9512-8384f94b215b is already attached to instances: ca8227d3-6b1f-4d92-90c7-41de2b3054bd {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:40:11.937168 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-258f7c26-b231-4ec4-82da-90e9443c7354 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "POST /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090928 Apr 12 00:40:11.937719 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 570/1166] 10.222.0.32 () {60 vars in 1322 bytes} [Tue Apr 12 00:40:11 2022] POST /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77/os-volume_attachments => generated 174 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:40:11.945858 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5d28976d-e3bd-4384-9938-29c55798b486 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:11.946374 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5d28976d-e3bd-4384-9938-29c55798b486 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:11.952873 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5d28976d-e3bd-4384-9938-29c55798b486 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:11.953316 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5d28976d-e3bd-4384-9938-29c55798b486 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:11.954062 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5d28976d-e3bd-4384-9938-29c55798b486 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:11.954522 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-5d28976d-e3bd-4384-9938-29c55798b486 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:11.977223 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-5d28976d-e3bd-4384-9938-29c55798b486 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Going to try to terminate instance {{(pid=128486) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:40:12.048675 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5d28976d-e3bd-4384-9938-29c55798b486 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 204 len: 0 microversion: 2.1 time: 0.106330 Apr 12 00:40:12.049255 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 597/1167] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:40:11 2022] DELETE /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:40:12.058395 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-facb568c-e620-4703-8756-d4c902968d59 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:12.059026 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-facb568c-e620-4703-8756-d4c902968d59 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:12.064837 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-facb568c-e620-4703-8756-d4c902968d59 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:12.065285 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-facb568c-e620-4703-8756-d4c902968d59 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:12.066047 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-facb568c-e620-4703-8756-d4c902968d59 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:12.066504 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-facb568c-e620-4703-8756-d4c902968d59 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:12.189394 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-facb568c-e620-4703-8756-d4c902968d59 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:12.196563 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-facb568c-e620-4703-8756-d4c902968d59 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 200 len: 1681 microversion: 2.1 time: 0.142972 Apr 12 00:40:12.197121 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 571/1168] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:12 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 1681 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:13.215367 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-d62d659f-e05a-4d79-94e2-0c7f8a5f398d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:13.216061 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-d62d659f-e05a-4d79-94e2-0c7f8a5f398d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:13.222482 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d62d659f-e05a-4d79-94e2-0c7f8a5f398d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:13.222927 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d62d659f-e05a-4d79-94e2-0c7f8a5f398d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:13.223672 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d62d659f-e05a-4d79-94e2-0c7f8a5f398d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:13.224099 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-d62d659f-e05a-4d79-94e2-0c7f8a5f398d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:13.348511 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-d62d659f-e05a-4d79-94e2-0c7f8a5f398d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:13.355824 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-d62d659f-e05a-4d79-94e2-0c7f8a5f398d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 200 len: 1681 microversion: 2.1 time: 0.145273 Apr 12 00:40:13.356384 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 598/1169] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:13 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:14.373457 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-991c450b-4e45-44a4-b733-cc6fb4d03122 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:14.374125 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-991c450b-4e45-44a4-b733-cc6fb4d03122 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:14.380419 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-991c450b-4e45-44a4-b733-cc6fb4d03122 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:14.380923 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-991c450b-4e45-44a4-b733-cc6fb4d03122 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:14.381734 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-991c450b-4e45-44a4-b733-cc6fb4d03122 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:14.382176 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-991c450b-4e45-44a4-b733-cc6fb4d03122 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:14.465003 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-991c450b-4e45-44a4-b733-cc6fb4d03122 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:14.472861 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-991c450b-4e45-44a4-b733-cc6fb4d03122 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 200 len: 1614 microversion: 2.1 time: 0.103783 Apr 12 00:40:14.473441 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 572/1170] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:14 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 1614 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:14.577293 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-e757116c-0e15-4694-a8bd-023221bad53c req-78029b26-becc-476d-87f5-b2797eab1fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a589bc8-9b32-4820-aa00-e5c764ba1b77", "name": "network-vif-deleted", "tag": "a3a93149-14b3-413d-b3d4-f6a40088a349"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:14.596631 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-e757116c-0e15-4694-a8bd-023221bad53c req-78029b26-becc-476d-87f5-b2797eab1fdc service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:14.597195 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-e757116c-0e15-4694-a8bd-023221bad53c req-78029b26-becc-476d-87f5-b2797eab1fdc service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:14.614646 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-e757116c-0e15-4694-a8bd-023221bad53c req-78029b26-becc-476d-87f5-b2797eab1fdc service nova] Creating event network-vif-deleted:a3a93149-14b3-413d-b3d4-f6a40088a349 for instance 8a589bc8-9b32-4820-aa00-e5c764ba1b77 on hv-cinder-83625 Apr 12 00:40:14.621730 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-e757116c-0e15-4694-a8bd-023221bad53c req-78029b26-becc-476d-87f5-b2797eab1fdc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049098 Apr 12 00:40:14.622997 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 599/1171] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:15.490693 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-8a06c497-5867-48b6-9ff9-e9a21180aa60 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:15.491304 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-8a06c497-5867-48b6-9ff9-e9a21180aa60 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:15.498768 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8a06c497-5867-48b6-9ff9-e9a21180aa60 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:15.499219 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8a06c497-5867-48b6-9ff9-e9a21180aa60 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:15.499991 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8a06c497-5867-48b6-9ff9-e9a21180aa60 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:15.500419 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-8a06c497-5867-48b6-9ff9-e9a21180aa60 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:15.514054 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-8a06c497-5867-48b6-9ff9-e9a21180aa60 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] HTTP exception thrown: Instance 8a589bc8-9b32-4820-aa00-e5c764ba1b77 could not be found. Apr 12 00:40:15.514676 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-8a06c497-5867-48b6-9ff9-e9a21180aa60 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Returning 404 to user: Instance 8a589bc8-9b32-4820-aa00-e5c764ba1b77 could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:40:15.515755 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-8a06c497-5867-48b6-9ff9-e9a21180aa60 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 404 len: 111 microversion: 2.1 time: 0.029002 Apr 12 00:40:15.516325 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 573/1172] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:15 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:40:15.525195 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8553bd4d-d4f6-4304-a271-f6897933e6d4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '.version_select at 0x7f64e6301a60>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:15.543847 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8553bd4d-d4f6-4304-a271-f6897933e6d4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-341800142" status: 202 len: 0 microversion: 2.1 time: 0.022756 Apr 12 00:40:15.544665 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 600/1173] 10.222.0.32 () {58 vars in 1217 bytes} [Tue Apr 12 00:40:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-341800142 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:40:16.208580 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-cee063f8-2736-4afb-adc1-7b535a5c8b1d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:16.209170 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-cee063f8-2736-4afb-adc1-7b535a5c8b1d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:16.215573 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cee063f8-2736-4afb-adc1-7b535a5c8b1d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:16.216011 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cee063f8-2736-4afb-adc1-7b535a5c8b1d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:16.216762 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cee063f8-2736-4afb-adc1-7b535a5c8b1d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:16.217186 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cee063f8-2736-4afb-adc1-7b535a5c8b1d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:16.294943 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-cee063f8-2736-4afb-adc1-7b535a5c8b1d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lazy-loading 'services' on Instance uuid ca8227d3-6b1f-4d92-90c7-41de2b3054bd {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:40:16.363955 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-cee063f8-2736-4afb-adc1-7b535a5c8b1d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd/os-volume_attachments/815277f6-d746-4ae1-9512-8384f94b215b" status: 202 len: 0 microversion: 2.1 time: 0.159117 Apr 12 00:40:16.364544 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 574/1174] 10.222.0.32 () {58 vars in 1415 bytes} [Tue Apr 12 00:40:16 2022] DELETE /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd/os-volume_attachments/815277f6-d746-4ae1-9512-8384f94b215b => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:40:16.374147 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-80dc1fbf-2bfb-41ea-b885-dcf040e6470b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:16.375320 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-80dc1fbf-2bfb-41ea-b885-dcf040e6470b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:16.382683 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-80dc1fbf-2bfb-41ea-b885-dcf040e6470b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:16.383210 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-80dc1fbf-2bfb-41ea-b885-dcf040e6470b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:16.383999 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-80dc1fbf-2bfb-41ea-b885-dcf040e6470b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:16.384451 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-80dc1fbf-2bfb-41ea-b885-dcf040e6470b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:16.415740 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-80dc1fbf-2bfb-41ea-b885-dcf040e6470b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046767 Apr 12 00:40:16.416304 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 601/1175] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:40:16 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:17.428251 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b45eb027-9ea8-467b-82f8-95d8db126bf1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:17.429298 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b45eb027-9ea8-467b-82f8-95d8db126bf1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:17.435320 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b45eb027-9ea8-467b-82f8-95d8db126bf1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:17.435767 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b45eb027-9ea8-467b-82f8-95d8db126bf1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:17.436577 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b45eb027-9ea8-467b-82f8-95d8db126bf1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:17.437002 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b45eb027-9ea8-467b-82f8-95d8db126bf1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:17.464283 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b45eb027-9ea8-467b-82f8-95d8db126bf1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040219 Apr 12 00:40:17.464823 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 575/1176] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:40:17 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:40:17.519661 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-45e68289-b82b-4cc1-a20c-cbcd172c7e6f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:17.520160 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-45e68289-b82b-4cc1-a20c-cbcd172c7e6f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:17.526863 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-45e68289-b82b-4cc1-a20c-cbcd172c7e6f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:17.527316 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-45e68289-b82b-4cc1-a20c-cbcd172c7e6f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:17.528071 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-45e68289-b82b-4cc1-a20c-cbcd172c7e6f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:17.528499 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-45e68289-b82b-4cc1-a20c-cbcd172c7e6f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:17.553732 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-45e68289-b82b-4cc1-a20c-cbcd172c7e6f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Going to try to terminate instance {{(pid=128486) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:40:17.625747 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-45e68289-b82b-4cc1-a20c-cbcd172c7e6f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 204 len: 0 microversion: 2.1 time: 0.109494 Apr 12 00:40:17.626655 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 602/1177] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:40:17 2022] DELETE /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:40:17.641095 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-0b8b84a6-ac66-4e48-9339-546f440e9c8d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:17.641704 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-0b8b84a6-ac66-4e48-9339-546f440e9c8d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:17.647573 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b8b84a6-ac66-4e48-9339-546f440e9c8d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:17.648020 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b8b84a6-ac66-4e48-9339-546f440e9c8d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:17.648864 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b8b84a6-ac66-4e48-9339-546f440e9c8d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:17.649287 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-0b8b84a6-ac66-4e48-9339-546f440e9c8d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:17.777812 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-0b8b84a6-ac66-4e48-9339-546f440e9c8d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:17.784991 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-0b8b84a6-ac66-4e48-9339-546f440e9c8d tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1681 microversion: 2.1 time: 0.154139 Apr 12 00:40:17.785549 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 576/1178] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:17 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:40:18.802548 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-67836906-a770-46e7-a082-fcc976b5f3e9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:18.803286 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-67836906-a770-46e7-a082-fcc976b5f3e9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:18.809484 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-67836906-a770-46e7-a082-fcc976b5f3e9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:18.809935 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-67836906-a770-46e7-a082-fcc976b5f3e9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:18.810728 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-67836906-a770-46e7-a082-fcc976b5f3e9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:18.811169 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-67836906-a770-46e7-a082-fcc976b5f3e9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:18.941000 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-67836906-a770-46e7-a082-fcc976b5f3e9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:18.948384 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-67836906-a770-46e7-a082-fcc976b5f3e9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1681 microversion: 2.1 time: 0.149964 Apr 12 00:40:18.948961 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 603/1179] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:18 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:19.965602 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5099b495-d7e6-4e19-924e-b15d917e24a8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:19.966219 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-5099b495-d7e6-4e19-924e-b15d917e24a8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:19.972647 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5099b495-d7e6-4e19-924e-b15d917e24a8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:19.973090 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5099b495-d7e6-4e19-924e-b15d917e24a8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:19.973880 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5099b495-d7e6-4e19-924e-b15d917e24a8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:19.974365 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-5099b495-d7e6-4e19-924e-b15d917e24a8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:20.167453 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-5099b495-d7e6-4e19-924e-b15d917e24a8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:20.174829 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5099b495-d7e6-4e19-924e-b15d917e24a8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1681 microversion: 2.1 time: 0.213782 Apr 12 00:40:20.175400 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 577/1180] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:19 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1681 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:20.811090 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-666711b7-ed45-47cf-a2c7-095a1ac40cf5 req-0b5ed8cf-e327-478e-87f5-b1df73cd9844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca8227d3-6b1f-4d92-90c7-41de2b3054bd", "name": "network-vif-deleted", "tag": "b26c3c3f-4a79-4918-90df-a275b5f37b5b"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:20.820854 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-666711b7-ed45-47cf-a2c7-095a1ac40cf5 req-0b5ed8cf-e327-478e-87f5-b1df73cd9844 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:20.821480 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-666711b7-ed45-47cf-a2c7-095a1ac40cf5 req-0b5ed8cf-e327-478e-87f5-b1df73cd9844 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:20.833718 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-666711b7-ed45-47cf-a2c7-095a1ac40cf5 req-0b5ed8cf-e327-478e-87f5-b1df73cd9844 service nova] Creating event network-vif-deleted:b26c3c3f-4a79-4918-90df-a275b5f37b5b for instance ca8227d3-6b1f-4d92-90c7-41de2b3054bd on hv-cinder-83625 Apr 12 00:40:20.839272 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-666711b7-ed45-47cf-a2c7-095a1ac40cf5 req-0b5ed8cf-e327-478e-87f5-b1df73cd9844 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031191 Apr 12 00:40:20.840036 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 604/1181] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:21.192814 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9df5b374-c89c-4b44-8f67-9e40b75d45ca tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:21.193425 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-9df5b374-c89c-4b44-8f67-9e40b75d45ca tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:21.199712 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9df5b374-c89c-4b44-8f67-9e40b75d45ca tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:21.200399 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9df5b374-c89c-4b44-8f67-9e40b75d45ca tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:21.201163 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9df5b374-c89c-4b44-8f67-9e40b75d45ca tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:21.201598 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9df5b374-c89c-4b44-8f67-9e40b75d45ca tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:21.232526 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9df5b374-c89c-4b44-8f67-9e40b75d45ca tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:21.232975 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9df5b374-c89c-4b44-8f67-9e40b75d45ca tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:21.233422 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.objects.instance [None req-9df5b374-c89c-4b44-8f67-9e40b75d45ca tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lazy-loading 'fault' on Instance uuid ca8227d3-6b1f-4d92-90c7-41de2b3054bd {{(pid=128487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:40:21.280917 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9df5b374-c89c-4b44-8f67-9e40b75d45ca tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:21.288376 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9df5b374-c89c-4b44-8f67-9e40b75d45ca tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 200 len: 1331 microversion: 2.1 time: 0.099384 Apr 12 00:40:21.289145 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 578/1182] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:21 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:22.306534 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c0f0a52d-8ec7-46d4-8df4-34ff4bb2162f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:22.307236 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-c0f0a52d-8ec7-46d4-8df4-34ff4bb2162f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:22.313662 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c0f0a52d-8ec7-46d4-8df4-34ff4bb2162f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:22.314113 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c0f0a52d-8ec7-46d4-8df4-34ff4bb2162f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:22.314912 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c0f0a52d-8ec7-46d4-8df4-34ff4bb2162f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:22.315348 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-c0f0a52d-8ec7-46d4-8df4-34ff4bb2162f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:22.328580 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-c0f0a52d-8ec7-46d4-8df4-34ff4bb2162f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] HTTP exception thrown: Instance ca8227d3-6b1f-4d92-90c7-41de2b3054bd could not be found. Apr 12 00:40:22.329188 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-c0f0a52d-8ec7-46d4-8df4-34ff4bb2162f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Returning 404 to user: Instance ca8227d3-6b1f-4d92-90c7-41de2b3054bd could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:40:22.330038 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-c0f0a52d-8ec7-46d4-8df4-34ff4bb2162f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 404 len: 111 microversion: 2.1 time: 0.027792 Apr 12 00:40:22.330650 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 605/1183] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:22 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:40:22.339747 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-736083a2-27a1-4987-ae17-14792b0ac744 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '.version_select at 0x7f64e1143790>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:22.356487 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-736083a2-27a1-4987-ae17-14792b0ac744 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831034167" status: 202 len: 0 microversion: 2.1 time: 0.021345 Apr 12 00:40:22.357046 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 579/1184] 10.222.0.32 () {58 vars in 1220 bytes} [Tue Apr 12 00:40:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831034167 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:40:22.964468 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-5ed1dae3-be50-42fb-9715-61283e6f1ee3 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Action: 'create', calling method: .version_select at 0x7f64e62b2af0>, body: {"keypair": {"name": "tempest-keypair-2133043091"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:22.977726 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-5ed1dae3-be50-42fb-9715-61283e6f1ee3 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:40:22.981983 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-5ed1dae3-be50-42fb-9715-61283e6f1ee3 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for user 69f5eaf4727f4bbf84ce10a5e07d582e and project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:40:23.111585 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-5ed1dae3-be50-42fb-9715-61283e6f1ee3 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:40:23.115335 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-5ed1dae3-be50-42fb-9715-61283e6f1ee3 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for user 69f5eaf4727f4bbf84ce10a5e07d582e and project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:40:23.128743 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-5ed1dae3-be50-42fb-9715-61283e6f1ee3 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.168114 Apr 12 00:40:23.129260 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 606/1185] 10.222.0.32 () {60 vars in 1157 bytes} [Tue Apr 12 00:40:22 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:24.325494 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-132b1938-e12a-4aea-b2a0-152fe9191d79 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-929567492", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad6fa16c-9ae9-409b-a431-15655dbe3bc7"}], "security_groups": [{"name": "tempest-securitygroup--1073504290"}], "key_name": "tempest-keypair-2133043091", "user_data": "}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:24.423187 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.network.neutron [None req-132b1938-e12a-4aea-b2a0-152fe9191d79 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] validate_networks() for [('ad6fa16c-9ae9-409b-a431-15655dbe3bc7', None, None, None, None, None)] {{(pid=128487) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:40:24.778629 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-132b1938-e12a-4aea-b2a0-152fe9191d79 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Flavor limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:40:24.779306 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-132b1938-e12a-4aea-b2a0-152fe9191d79 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Image limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:40:24.779775 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-132b1938-e12a-4aea-b2a0-152fe9191d79 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Flavor pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:40:24.780174 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-132b1938-e12a-4aea-b2a0-152fe9191d79 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Image pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:40:24.780578 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-132b1938-e12a-4aea-b2a0-152fe9191d79 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:40:24.789163 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-132b1938-e12a-4aea-b2a0-152fe9191d79 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:24.789551 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-132b1938-e12a-4aea-b2a0-152fe9191d79 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:24.790370 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-132b1938-e12a-4aea-b2a0-152fe9191d79 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:24.790800 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-132b1938-e12a-4aea-b2a0-152fe9191d79 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:24.807120 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-132b1938-e12a-4aea-b2a0-152fe9191d79 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:40:24.810927 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-132b1938-e12a-4aea-b2a0-152fe9191d79 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for user 69f5eaf4727f4bbf84ce10a5e07d582e and project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:40:24.821336 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-132b1938-e12a-4aea-b2a0-152fe9191d79 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Going to run 1 instances... {{(pid=128487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:40:24.823584 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-132b1938-e12a-4aea-b2a0-152fe9191d79 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:40:24.868798 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-132b1938-e12a-4aea-b2a0-152fe9191d79 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.548119 Apr 12 00:40:24.869534 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 580/1186] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:40:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:40:24.879848 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ef0ad78d-89cb-4636-afd7-a306289c42e0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:24.880594 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ef0ad78d-89cb-4636-afd7-a306289c42e0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:24.936501 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-ef0ad78d-89cb-4636-afd7-a306289c42e0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:24.943836 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ef0ad78d-89cb-4636-afd7-a306289c42e0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1241 microversion: 2.1 time: 0.068285 Apr 12 00:40:24.944388 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 607/1187] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:24 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:25.960857 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-74d45b9b-2dad-4703-9048-5d31b7ae2785 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:25.961579 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-74d45b9b-2dad-4703-9048-5d31b7ae2785 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:26.014633 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-74d45b9b-2dad-4703-9048-5d31b7ae2785 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:26.021318 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-74d45b9b-2dad-4703-9048-5d31b7ae2785 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1241 microversion: 2.1 time: 0.064387 Apr 12 00:40:26.021881 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 581/1188] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:25 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:27.037636 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-40ee9c98-4ab1-4b7b-9180-41f04205ebd8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:27.038271 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-40ee9c98-4ab1-4b7b-9180-41f04205ebd8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:27.090392 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-40ee9c98-4ab1-4b7b-9180-41f04205ebd8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:27.096869 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-40ee9c98-4ab1-4b7b-9180-41f04205ebd8 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1241 microversion: 2.1 time: 0.063006 Apr 12 00:40:27.097424 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 608/1189] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:27 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1241 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:28.114200 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-c922ce48-8978-4e1f-a127-b083c65f7914 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:28.114841 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-c922ce48-8978-4e1f-a127-b083c65f7914 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:28.171089 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-c922ce48-8978-4e1f-a127-b083c65f7914 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:28.177616 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-c922ce48-8978-4e1f-a127-b083c65f7914 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1241 microversion: 2.1 time: 0.067301 Apr 12 00:40:28.178227 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 582/1190] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:28 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:29.194270 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3f04ca93-e3c0-4862-a70c-a821f1c8eab4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:29.194958 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3f04ca93-e3c0-4862-a70c-a821f1c8eab4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:29.200737 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3f04ca93-e3c0-4862-a70c-a821f1c8eab4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:29.201179 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3f04ca93-e3c0-4862-a70c-a821f1c8eab4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:29.201930 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3f04ca93-e3c0-4862-a70c-a821f1c8eab4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:29.202402 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3f04ca93-e3c0-4862-a70c-a821f1c8eab4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:29.261795 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3f04ca93-e3c0-4862-a70c-a821f1c8eab4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:29.270162 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3f04ca93-e3c0-4862-a70c-a821f1c8eab4 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1245 microversion: 2.1 time: 0.079689 Apr 12 00:40:29.270967 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 609/1191] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:29 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:30.287626 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-719a6773-fc45-4623-8b59-500d15fd951a tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:30.288298 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-719a6773-fc45-4623-8b59-500d15fd951a tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:30.296173 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-719a6773-fc45-4623-8b59-500d15fd951a tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:30.296618 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-719a6773-fc45-4623-8b59-500d15fd951a tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:30.297388 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-719a6773-fc45-4623-8b59-500d15fd951a tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:30.297815 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-719a6773-fc45-4623-8b59-500d15fd951a tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:30.359891 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-719a6773-fc45-4623-8b59-500d15fd951a tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:30.367408 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-719a6773-fc45-4623-8b59-500d15fd951a tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1299 microversion: 2.1 time: 0.083641 Apr 12 00:40:30.367981 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 583/1192] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:30 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:31.250356 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-c8e03a44-4b88-4860-a0cf-9e8d7b50ba68 req-c3f56a61-3e7c-48d3-8d0e-66e28f998db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ab1db03-6d57-4cc4-8f8d-8f3d89295019", "tag": "3a13265b-2931-4702-abb1-4e7e0743d747"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:31.260623 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-c8e03a44-4b88-4860-a0cf-9e8d7b50ba68 req-c3f56a61-3e7c-48d3-8d0e-66e28f998db3 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:31.261092 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-c8e03a44-4b88-4860-a0cf-9e8d7b50ba68 req-c3f56a61-3e7c-48d3-8d0e-66e28f998db3 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:31.272728 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-c8e03a44-4b88-4860-a0cf-9e8d7b50ba68 req-c3f56a61-3e7c-48d3-8d0e-66e28f998db3 service nova] Creating event network-changed:3a13265b-2931-4702-abb1-4e7e0743d747 for instance 1ab1db03-6d57-4cc4-8f8d-8f3d89295019 on hv-cinder-83625 Apr 12 00:40:31.278427 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-c8e03a44-4b88-4860-a0cf-9e8d7b50ba68 req-c3f56a61-3e7c-48d3-8d0e-66e28f998db3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033877 Apr 12 00:40:31.279206 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 610/1193] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:31.385290 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a78dff3f-cd70-4d16-ab64-6b4b76e293ff tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:31.386064 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-a78dff3f-cd70-4d16-ab64-6b4b76e293ff tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:31.392959 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a78dff3f-cd70-4d16-ab64-6b4b76e293ff tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:31.393520 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a78dff3f-cd70-4d16-ab64-6b4b76e293ff tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:31.394429 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a78dff3f-cd70-4d16-ab64-6b4b76e293ff tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:31.394870 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-a78dff3f-cd70-4d16-ab64-6b4b76e293ff tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:31.588766 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-a78dff3f-cd70-4d16-ab64-6b4b76e293ff tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:31.595996 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a78dff3f-cd70-4d16-ab64-6b4b76e293ff tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1367 microversion: 2.1 time: 0.214629 Apr 12 00:40:31.596579 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 584/1194] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:31 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:32.614412 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-11e927aa-7a14-4280-bf3f-7131dc9283c9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:32.615130 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-11e927aa-7a14-4280-bf3f-7131dc9283c9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:32.621184 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-11e927aa-7a14-4280-bf3f-7131dc9283c9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:32.621629 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-11e927aa-7a14-4280-bf3f-7131dc9283c9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:32.622403 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-11e927aa-7a14-4280-bf3f-7131dc9283c9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:32.622839 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-11e927aa-7a14-4280-bf3f-7131dc9283c9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:32.745223 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-11e927aa-7a14-4280-bf3f-7131dc9283c9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:32.752358 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-11e927aa-7a14-4280-bf3f-7131dc9283c9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1367 microversion: 2.1 time: 0.142565 Apr 12 00:40:32.752919 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 611/1195] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:32 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1367 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:33.769064 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-cac84e09-f1b2-4c67-bff1-59bcf2f9a7bf tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:33.769668 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-cac84e09-f1b2-4c67-bff1-59bcf2f9a7bf tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:33.776377 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cac84e09-f1b2-4c67-bff1-59bcf2f9a7bf tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:33.776847 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cac84e09-f1b2-4c67-bff1-59bcf2f9a7bf tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:33.777614 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cac84e09-f1b2-4c67-bff1-59bcf2f9a7bf tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:33.778039 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cac84e09-f1b2-4c67-bff1-59bcf2f9a7bf tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:33.968145 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-cac84e09-f1b2-4c67-bff1-59bcf2f9a7bf tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:33.975385 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-cac84e09-f1b2-4c67-bff1-59bcf2f9a7bf tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1367 microversion: 2.1 time: 0.210410 Apr 12 00:40:33.975966 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 585/1196] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:33 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:34.992247 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-1dac1307-7a3e-475f-a5e4-b13cab5e42e0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:34.992859 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-1dac1307-7a3e-475f-a5e4-b13cab5e42e0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:35.000048 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1dac1307-7a3e-475f-a5e4-b13cab5e42e0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:35.000494 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1dac1307-7a3e-475f-a5e4-b13cab5e42e0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:35.001259 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1dac1307-7a3e-475f-a5e4-b13cab5e42e0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:35.001698 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-1dac1307-7a3e-475f-a5e4-b13cab5e42e0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:35.129970 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-1dac1307-7a3e-475f-a5e4-b13cab5e42e0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:35.137095 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-1dac1307-7a3e-475f-a5e4-b13cab5e42e0 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1367 microversion: 2.1 time: 0.148711 Apr 12 00:40:35.137657 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 612/1197] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:34 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:36.154677 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9b1ac2c8-26a9-404b-860c-03a858815e3f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:36.155293 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-9b1ac2c8-26a9-404b-860c-03a858815e3f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:36.161533 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9b1ac2c8-26a9-404b-860c-03a858815e3f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:36.162276 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9b1ac2c8-26a9-404b-860c-03a858815e3f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:36.163036 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9b1ac2c8-26a9-404b-860c-03a858815e3f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:36.163469 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9b1ac2c8-26a9-404b-860c-03a858815e3f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:36.289689 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9b1ac2c8-26a9-404b-860c-03a858815e3f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:36.297358 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9b1ac2c8-26a9-404b-860c-03a858815e3f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1367 microversion: 2.1 time: 0.147096 Apr 12 00:40:36.297920 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 586/1198] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:36 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:37.022233 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-87c25236-1fc6-43bf-b96c-0bf88972760a req-3fa7d616-953f-4f69-a898-fb3e7436ea74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab1db03-6d57-4cc4-8f8d-8f3d89295019", "name": "network-vif-plugged", "status": "completed", "tag": "3a13265b-2931-4702-abb1-4e7e0743d747"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:37.031560 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-87c25236-1fc6-43bf-b96c-0bf88972760a req-3fa7d616-953f-4f69-a898-fb3e7436ea74 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:37.032374 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-87c25236-1fc6-43bf-b96c-0bf88972760a req-3fa7d616-953f-4f69-a898-fb3e7436ea74 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:37.044219 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-87c25236-1fc6-43bf-b96c-0bf88972760a req-3fa7d616-953f-4f69-a898-fb3e7436ea74 service nova] Creating event network-vif-plugged:3a13265b-2931-4702-abb1-4e7e0743d747 for instance 1ab1db03-6d57-4cc4-8f8d-8f3d89295019 on hv-cinder-83625 Apr 12 00:40:37.048898 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-87c25236-1fc6-43bf-b96c-0bf88972760a req-3fa7d616-953f-4f69-a898-fb3e7436ea74 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030593 Apr 12 00:40:37.049672 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 613/1199] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:37.314273 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2bf7b4e2-e276-47d6-86cd-413eb15a5f7f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:37.314891 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2bf7b4e2-e276-47d6-86cd-413eb15a5f7f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:37.320600 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2bf7b4e2-e276-47d6-86cd-413eb15a5f7f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:37.321046 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2bf7b4e2-e276-47d6-86cd-413eb15a5f7f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:37.321800 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2bf7b4e2-e276-47d6-86cd-413eb15a5f7f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:37.322229 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2bf7b4e2-e276-47d6-86cd-413eb15a5f7f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:37.445289 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-2bf7b4e2-e276-47d6-86cd-413eb15a5f7f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:37.452438 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2bf7b4e2-e276-47d6-86cd-413eb15a5f7f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1367 microversion: 2.1 time: 0.142190 Apr 12 00:40:37.453010 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 587/1200] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:37 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1367 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:37.884322 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4769a018-2b57-4084-912a-2000aabcef76 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1041762533"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:37.885468 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4769a018-2b57-4084-912a-2000aabcef76 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:37.892057 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4769a018-2b57-4084-912a-2000aabcef76 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:37.892516 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4769a018-2b57-4084-912a-2000aabcef76 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:37.893382 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4769a018-2b57-4084-912a-2000aabcef76 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:37.893754 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4769a018-2b57-4084-912a-2000aabcef76 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:38.017084 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.network.security_group_api [None req-4769a018-2b57-4084-912a-2000aabcef76 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Removing security group bf733550-9bd9-424e-8525-7508fddcb233 from port f8104ec7-8594-4188-ae28-392ce2284da2 Apr 12 00:40:38.376824 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4769a018-2b57-4084-912a-2000aabcef76 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "POST /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2/action" status: 202 len: 0 microversion: 2.1 time: 0.496698 Apr 12 00:40:38.379746 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 614/1201] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Apr 12 00:40:37 2022] POST /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:40:38.387980 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-8c185fc8-0e70-42a9-9cd2-e1e6ace36282 req-4444d3cd-d57a-474e-91bf-7bb92882d657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ec626f-1d95-45d9-8293-40d6408a52d2", "tag": "f8104ec7-8594-4188-ae28-392ce2284da2"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:38.396836 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-8c185fc8-0e70-42a9-9cd2-e1e6ace36282 req-4444d3cd-d57a-474e-91bf-7bb92882d657 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:38.397543 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-8c185fc8-0e70-42a9-9cd2-e1e6ace36282 req-4444d3cd-d57a-474e-91bf-7bb92882d657 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:38.409891 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-8c185fc8-0e70-42a9-9cd2-e1e6ace36282 req-4444d3cd-d57a-474e-91bf-7bb92882d657 service nova] Creating event network-changed:f8104ec7-8594-4188-ae28-392ce2284da2 for instance 90ec626f-1d95-45d9-8293-40d6408a52d2 on hv-cinder-83625 Apr 12 00:40:38.416151 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-8c185fc8-0e70-42a9-9cd2-e1e6ace36282 req-4444d3cd-d57a-474e-91bf-7bb92882d657 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032840 Apr 12 00:40:38.417358 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 588/1202] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:40:38.471448 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9a9bdda2-81c5-4eb5-8675-35772f3588b9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:38.472072 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9a9bdda2-81c5-4eb5-8675-35772f3588b9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:38.479011 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9a9bdda2-81c5-4eb5-8675-35772f3588b9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:38.479661 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9a9bdda2-81c5-4eb5-8675-35772f3588b9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:38.480600 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9a9bdda2-81c5-4eb5-8675-35772f3588b9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:38.481213 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9a9bdda2-81c5-4eb5-8675-35772f3588b9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:38.673134 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9a9bdda2-81c5-4eb5-8675-35772f3588b9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:38.682724 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9a9bdda2-81c5-4eb5-8675-35772f3588b9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1367 microversion: 2.1 time: 0.216765 Apr 12 00:40:38.692541 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 615/1203] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:38 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:39.699236 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b7adb2b4-fc94-43d8-93b0-5d1257869d02 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:39.700135 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b7adb2b4-fc94-43d8-93b0-5d1257869d02 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:39.706670 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b7adb2b4-fc94-43d8-93b0-5d1257869d02 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:39.707212 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b7adb2b4-fc94-43d8-93b0-5d1257869d02 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:39.708041 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b7adb2b4-fc94-43d8-93b0-5d1257869d02 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:39.708541 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b7adb2b4-fc94-43d8-93b0-5d1257869d02 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:40.143425 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-304b1c5a-462b-4f0a-bff6-5a5e6e82d6c2 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:40.143989 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-304b1c5a-462b-4f0a-bff6-5a5e6e82d6c2 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:40.151733 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-304b1c5a-462b-4f0a-bff6-5a5e6e82d6c2 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:40.152173 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-304b1c5a-462b-4f0a-bff6-5a5e6e82d6c2 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:40.153222 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-304b1c5a-462b-4f0a-bff6-5a5e6e82d6c2 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:40.153913 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-304b1c5a-462b-4f0a-bff6-5a5e6e82d6c2 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:40.159721 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b7adb2b4-fc94-43d8-93b0-5d1257869d02 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:40.167961 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b7adb2b4-fc94-43d8-93b0-5d1257869d02 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1557 microversion: 2.1 time: 0.472838 Apr 12 00:40:40.168947 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 589/1204] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:39 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1557 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:40.184801 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-9e17a590-2325-4b31-b25a-ae5fca8fac57 req-fa83cdd9-1286-4e21-a8c5-090253d7885d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ec626f-1d95-45d9-8293-40d6408a52d2", "tag": "f8104ec7-8594-4188-ae28-392ce2284da2"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:40.193893 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-9e17a590-2325-4b31-b25a-ae5fca8fac57 req-fa83cdd9-1286-4e21-a8c5-090253d7885d service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:40.194440 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-9e17a590-2325-4b31-b25a-ae5fca8fac57 req-fa83cdd9-1286-4e21-a8c5-090253d7885d service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:40.205817 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-9e17a590-2325-4b31-b25a-ae5fca8fac57 req-fa83cdd9-1286-4e21-a8c5-090253d7885d service nova] Creating event network-changed:f8104ec7-8594-4188-ae28-392ce2284da2 for instance 90ec626f-1d95-45d9-8293-40d6408a52d2 on hv-cinder-83625 Apr 12 00:40:40.211157 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-9e17a590-2325-4b31-b25a-ae5fca8fac57 req-fa83cdd9-1286-4e21-a8c5-090253d7885d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030787 Apr 12 00:40:40.212030 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 590/1205] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:40.220596 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2eaf7dba-3436-4363-a7b6-7b54ec8e9e30 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:40.221243 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2eaf7dba-3436-4363-a7b6-7b54ec8e9e30 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:40.227317 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2eaf7dba-3436-4363-a7b6-7b54ec8e9e30 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:40.227840 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2eaf7dba-3436-4363-a7b6-7b54ec8e9e30 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:40.229191 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2eaf7dba-3436-4363-a7b6-7b54ec8e9e30 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:40.229750 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2eaf7dba-3436-4363-a7b6-7b54ec8e9e30 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:40.239532 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-304b1c5a-462b-4f0a-bff6-5a5e6e82d6c2 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lazy-loading 'services' on Instance uuid 90ec626f-1d95-45d9-8293-40d6408a52d2 {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:40:40.314583 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-304b1c5a-462b-4f0a-bff6-5a5e6e82d6c2 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "DELETE /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2/os-volume_attachments/7a8286da-da02-41ae-83d2-f7c37a25a4ce" status: 202 len: 0 microversion: 2.1 time: 0.175580 Apr 12 00:40:40.316405 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 616/1206] 10.222.0.32 () {58 vars in 1415 bytes} [Tue Apr 12 00:40:40 2022] DELETE /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2/os-volume_attachments/7a8286da-da02-41ae-83d2-f7c37a25a4ce => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 00:40:40.325211 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ab6a628b-e1e5-45f8-967e-95acfff1374c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:40.326754 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ab6a628b-e1e5-45f8-967e-95acfff1374c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:40.333532 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ab6a628b-e1e5-45f8-967e-95acfff1374c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:40.334134 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ab6a628b-e1e5-45f8-967e-95acfff1374c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:40.334990 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ab6a628b-e1e5-45f8-967e-95acfff1374c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:40.335701 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ab6a628b-e1e5-45f8-967e-95acfff1374c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:40.345668 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2eaf7dba-3436-4363-a7b6-7b54ec8e9e30 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128491 Apr 12 00:40:40.352976 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 591/1207] 10.222.0.32 () {58 vars in 1274 bytes} [Tue Apr 12 00:40:40 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:40.379451 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ab6a628b-e1e5-45f8-967e-95acfff1374c tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059423 Apr 12 00:40:40.384427 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 617/1208] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:40:40 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:41.392759 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-69e11faa-4d62-46c5-adbb-0f04397a151f tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:41.393688 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-69e11faa-4d62-46c5-adbb-0f04397a151f tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:41.399597 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-69e11faa-4d62-46c5-adbb-0f04397a151f tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:41.400051 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-69e11faa-4d62-46c5-adbb-0f04397a151f tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:41.401329 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-69e11faa-4d62-46c5-adbb-0f04397a151f tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:41.401769 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-69e11faa-4d62-46c5-adbb-0f04397a151f tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:41.429600 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-69e11faa-4d62-46c5-adbb-0f04397a151f tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041568 Apr 12 00:40:41.430174 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 592/1209] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:40:41 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:40:41.440027 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-cbdb9608-bdac-45f7-afea-b1593a3e20d1 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:41.440564 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-cbdb9608-bdac-45f7-afea-b1593a3e20d1 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:41.446822 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-cbdb9608-bdac-45f7-afea-b1593a3e20d1 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:41.447282 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-cbdb9608-bdac-45f7-afea-b1593a3e20d1 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:41.448061 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-cbdb9608-bdac-45f7-afea-b1593a3e20d1 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:41.448484 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-cbdb9608-bdac-45f7-afea-b1593a3e20d1 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:41.520172 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-cbdb9608-bdac-45f7-afea-b1593a3e20d1 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] HTTP exception thrown: Instance 90ec626f-1d95-45d9-8293-40d6408a52d2 is not attached to volume 7a8286da-da02-41ae-83d2-f7c37a25a4ce Apr 12 00:40:41.520768 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-cbdb9608-bdac-45f7-afea-b1593a3e20d1 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Returning 404 to user: Instance 90ec626f-1d95-45d9-8293-40d6408a52d2 is not attached to volume 7a8286da-da02-41ae-83d2-f7c37a25a4ce {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:40:41.521595 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-cbdb9608-bdac-45f7-afea-b1593a3e20d1 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "DELETE /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2/os-volume_attachments/7a8286da-da02-41ae-83d2-f7c37a25a4ce" status: 404 len: 154 microversion: 2.1 time: 0.085724 Apr 12 00:40:41.522303 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 618/1210] 10.222.0.32 () {58 vars in 1415 bytes} [Tue Apr 12 00:40:41 2022] DELETE /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2/os-volume_attachments/7a8286da-da02-41ae-83d2-f7c37a25a4ce => generated 154 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:40:41.608896 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-2f10e33d-331a-47de-b33f-1d9c82a221bd req-dc88fe7b-201a-4740-bd77-dc302c20db51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ab1db03-6d57-4cc4-8f8d-8f3d89295019", "tag": "3a13265b-2931-4702-abb1-4e7e0743d747"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:41.617707 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-2f10e33d-331a-47de-b33f-1d9c82a221bd req-dc88fe7b-201a-4740-bd77-dc302c20db51 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:41.618303 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-2f10e33d-331a-47de-b33f-1d9c82a221bd req-dc88fe7b-201a-4740-bd77-dc302c20db51 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:41.631044 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-2f10e33d-331a-47de-b33f-1d9c82a221bd req-dc88fe7b-201a-4740-bd77-dc302c20db51 service nova] Creating event network-changed:3a13265b-2931-4702-abb1-4e7e0743d747 for instance 1ab1db03-6d57-4cc4-8f8d-8f3d89295019 on hv-cinder-83625 Apr 12 00:40:41.645271 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-2f10e33d-331a-47de-b33f-1d9c82a221bd req-dc88fe7b-201a-4740-bd77-dc302c20db51 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039958 Apr 12 00:40:41.646182 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 593/1211] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:42.672166 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-47e4bc8b-a1b8-4ae9-b1c6-c92b3f204dbc tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:42.672763 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-47e4bc8b-a1b8-4ae9-b1c6-c92b3f204dbc tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:42.679515 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-47e4bc8b-a1b8-4ae9-b1c6-c92b3f204dbc tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:42.680045 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-47e4bc8b-a1b8-4ae9-b1c6-c92b3f204dbc tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:42.680877 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-47e4bc8b-a1b8-4ae9-b1c6-c92b3f204dbc tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:42.681377 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-47e4bc8b-a1b8-4ae9-b1c6-c92b3f204dbc tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:42.711369 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-47e4bc8b-a1b8-4ae9-b1c6-c92b3f204dbc tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Going to try to terminate instance {{(pid=128486) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:40:42.784104 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-47e4bc8b-a1b8-4ae9-b1c6-c92b3f204dbc tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "DELETE /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 204 len: 0 microversion: 2.1 time: 0.115674 Apr 12 00:40:42.784798 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 619/1212] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:40:42 2022] DELETE /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:40:42.794112 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-4aa04457-7355-452e-9207-3ef0dade3db7 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:42.794952 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-4aa04457-7355-452e-9207-3ef0dade3db7 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:42.800888 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4aa04457-7355-452e-9207-3ef0dade3db7 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:42.801248 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4aa04457-7355-452e-9207-3ef0dade3db7 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:42.801994 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4aa04457-7355-452e-9207-3ef0dade3db7 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:42.802460 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-4aa04457-7355-452e-9207-3ef0dade3db7 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:42.930668 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-4aa04457-7355-452e-9207-3ef0dade3db7 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:42.938862 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-4aa04457-7355-452e-9207-3ef0dade3db7 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1554 microversion: 2.1 time: 0.149468 Apr 12 00:40:42.939437 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 594/1213] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:42 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:43.956834 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2e58e2ee-b862-419b-8b47-c09c3395e712 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:43.957527 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-2e58e2ee-b862-419b-8b47-c09c3395e712 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:43.964411 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2e58e2ee-b862-419b-8b47-c09c3395e712 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:43.964849 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2e58e2ee-b862-419b-8b47-c09c3395e712 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:43.965650 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2e58e2ee-b862-419b-8b47-c09c3395e712 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:43.966079 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-2e58e2ee-b862-419b-8b47-c09c3395e712 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:44.093432 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-2e58e2ee-b862-419b-8b47-c09c3395e712 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:44.100620 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2e58e2ee-b862-419b-8b47-c09c3395e712 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1554 microversion: 2.1 time: 0.148241 Apr 12 00:40:44.101173 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 620/1214] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:43 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:45.116843 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-048cabef-a661-48a8-bb0b-a894670900ee tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:45.117468 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-048cabef-a661-48a8-bb0b-a894670900ee tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:45.123696 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-048cabef-a661-48a8-bb0b-a894670900ee tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:45.124137 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-048cabef-a661-48a8-bb0b-a894670900ee tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:45.124885 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-048cabef-a661-48a8-bb0b-a894670900ee tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:45.125314 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-048cabef-a661-48a8-bb0b-a894670900ee tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:45.332502 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-048cabef-a661-48a8-bb0b-a894670900ee tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea857a427b0464daf88491b3d4ecbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba38491d23d64bd58eabf7ea16fd68e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:40:45.340272 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-048cabef-a661-48a8-bb0b-a894670900ee tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 200 len: 1554 microversion: 2.1 time: 0.227226 Apr 12 00:40:45.341067 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 595/1215] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:45 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 1554 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:45.580243 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-e81706ef-0cab-4aca-8724-9a14acf861d3 req-33c747b1-6bbe-41ac-bdb2-0eaac9b31fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ec626f-1d95-45d9-8293-40d6408a52d2", "name": "network-vif-deleted", "tag": "f8104ec7-8594-4188-ae28-392ce2284da2"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:45.589201 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-e81706ef-0cab-4aca-8724-9a14acf861d3 req-33c747b1-6bbe-41ac-bdb2-0eaac9b31fb3 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:45.589672 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-e81706ef-0cab-4aca-8724-9a14acf861d3 req-33c747b1-6bbe-41ac-bdb2-0eaac9b31fb3 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:45.600473 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-e81706ef-0cab-4aca-8724-9a14acf861d3 req-33c747b1-6bbe-41ac-bdb2-0eaac9b31fb3 service nova] Creating event network-vif-deleted:f8104ec7-8594-4188-ae28-392ce2284da2 for instance 90ec626f-1d95-45d9-8293-40d6408a52d2 on hv-cinder-83625 Apr 12 00:40:45.605287 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-e81706ef-0cab-4aca-8724-9a14acf861d3 req-33c747b1-6bbe-41ac-bdb2-0eaac9b31fb3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028567 Apr 12 00:40:45.605819 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 621/1216] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:46.357540 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e53185d6-f982-4d37-a21a-95e1b4bfae71 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:46.358161 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e53185d6-f982-4d37-a21a-95e1b4bfae71 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] [instance: 90ec626f-1d95-45d9-8293-40d6408a52d2] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:40:46.364135 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e53185d6-f982-4d37-a21a-95e1b4bfae71 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:46.364586 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e53185d6-f982-4d37-a21a-95e1b4bfae71 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:46.365350 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e53185d6-f982-4d37-a21a-95e1b4bfae71 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:40:46.365785 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e53185d6-f982-4d37-a21a-95e1b4bfae71 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:40:46.379405 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-e53185d6-f982-4d37-a21a-95e1b4bfae71 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] HTTP exception thrown: Instance 90ec626f-1d95-45d9-8293-40d6408a52d2 could not be found. Apr 12 00:40:46.379984 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e53185d6-f982-4d37-a21a-95e1b4bfae71 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Returning 404 to user: Instance 90ec626f-1d95-45d9-8293-40d6408a52d2 could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:40:46.380791 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e53185d6-f982-4d37-a21a-95e1b4bfae71 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2" status: 404 len: 111 microversion: 2.1 time: 0.027781 Apr 12 00:40:46.381316 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 596/1217] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:40:46 2022] GET /compute/v2.1/servers/90ec626f-1d95-45d9-8293-40d6408a52d2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:40:46.390037 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b38f62bb-8f91-4248-8975-f27461197ea0 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] Calling method '.version_select at 0x7f64e62579d0>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:46.407489 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b38f62bb-8f91-4248-8975-f27461197ea0 tempest-TestMinimumBasicScenario-857425665 tempest-TestMinimumBasicScenario-857425665-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1916231708" status: 202 len: 0 microversion: 2.1 time: 0.021779 Apr 12 00:40:46.408014 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 622/1218] 10.222.0.32 () {58 vars in 1271 bytes} [Tue Apr 12 00:40:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1916231708 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:41:46.300850 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2adc19e4-783b-4a38-9ff3-a988a775f838] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 12 00:41:46.530874 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-1b99ce98-8685-45cb-a6ca-125f6f181ddd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:46.531369 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-1b99ce98-8685-45cb-a6ca-125f6f181ddd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:41:46.537158 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1b99ce98-8685-45cb-a6ca-125f6f181ddd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:46.537601 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1b99ce98-8685-45cb-a6ca-125f6f181ddd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:46.538379 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1b99ce98-8685-45cb-a6ca-125f6f181ddd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:46.538821 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-1b99ce98-8685-45cb-a6ca-125f6f181ddd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:46.560887 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-1b99ce98-8685-45cb-a6ca-125f6f181ddd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019/ips" status: 200 len: 150 microversion: 2.1 time: 0.261537 Apr 12 00:41:46.561435 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 597/1219] 10.222.0.32 () {58 vars in 1247 bytes} [Tue Apr 12 00:41:46 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019/ips => generated 150 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:41:47.864402 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-bec7d5d4-07b8-4b06-8b94-33f4ae4087bd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccddbb51-5350-48d8-8915-0cc5a897500b"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:41:47.865562 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-bec7d5d4-07b8-4b06-8b94-33f4ae4087bd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:41:47.872846 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bec7d5d4-07b8-4b06-8b94-33f4ae4087bd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:47.873235 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bec7d5d4-07b8-4b06-8b94-33f4ae4087bd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:47.873994 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bec7d5d4-07b8-4b06-8b94-33f4ae4087bd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:47.874473 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-bec7d5d4-07b8-4b06-8b94-33f4ae4087bd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:48.232844 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-bec7d5d4-07b8-4b06-8b94-33f4ae4087bd tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "POST /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.373545 Apr 12 00:41:48.233428 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 623/1220] 10.222.0.32 () {60 vars in 1322 bytes} [Tue Apr 12 00:41:47 2022] POST /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:41:55.701779 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2a196ad5-4d3b-45a8-8175-331867c31049 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccddbb51-5350-48d8-8915-0cc5a897500b"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:41:55.702935 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-2a196ad5-4d3b-45a8-8175-331867c31049 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:41:55.710430 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2a196ad5-4d3b-45a8-8175-331867c31049 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:55.710888 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2a196ad5-4d3b-45a8-8175-331867c31049 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:55.712192 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2a196ad5-4d3b-45a8-8175-331867c31049 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:55.712636 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-2a196ad5-4d3b-45a8-8175-331867c31049 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:55.718150 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO oslo.messaging._drivers.impl_rabbit [-] [2adc19e4-783b-4a38-9ff3-a988a775f838] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 36662. Apr 12 00:41:55.839183 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-2a196ad5-4d3b-45a8-8175-331867c31049 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] HTTP exception thrown: Invalid volume: volume ccddbb51-5350-48d8-8915-0cc5a897500b is already attached to instances: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019 Apr 12 00:41:55.839777 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-2a196ad5-4d3b-45a8-8175-331867c31049 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Returning 400 to user: Invalid volume: volume ccddbb51-5350-48d8-8915-0cc5a897500b is already attached to instances: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019 {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:41:55.840609 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-2a196ad5-4d3b-45a8-8175-331867c31049 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "POST /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.142872 Apr 12 00:41:55.841158 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 598/1221] 10.222.0.32 () {60 vars in 1322 bytes} [Tue Apr 12 00:41:55 2022] POST /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019/os-volume_attachments => generated 174 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:41:55.901269 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-fd31b67f-83bf-44f4-bd97-d077314406f7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:55.901943 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-fd31b67f-83bf-44f4-bd97-d077314406f7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:41:55.908060 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fd31b67f-83bf-44f4-bd97-d077314406f7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:55.908655 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fd31b67f-83bf-44f4-bd97-d077314406f7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:55.909534 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fd31b67f-83bf-44f4-bd97-d077314406f7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:55.910033 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-fd31b67f-83bf-44f4-bd97-d077314406f7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:55.988287 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-fd31b67f-83bf-44f4-bd97-d077314406f7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lazy-loading 'services' on Instance uuid 1ab1db03-6d57-4cc4-8f8d-8f3d89295019 {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:41:56.054950 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-fd31b67f-83bf-44f4-bd97-d077314406f7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019/os-volume_attachments/ccddbb51-5350-48d8-8915-0cc5a897500b" status: 202 len: 0 microversion: 2.1 time: 0.159014 Apr 12 00:41:56.055516 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 624/1222] 10.222.0.32 () {58 vars in 1415 bytes} [Tue Apr 12 00:41:55 2022] DELETE /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019/os-volume_attachments/ccddbb51-5350-48d8-8915-0cc5a897500b => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 00:41:56.064569 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-61a63d4d-e6e8-4248-98e9-d695f819d148 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:56.065519 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-61a63d4d-e6e8-4248-98e9-d695f819d148 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:41:56.072124 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-61a63d4d-e6e8-4248-98e9-d695f819d148 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:56.072592 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-61a63d4d-e6e8-4248-98e9-d695f819d148 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:56.073507 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-61a63d4d-e6e8-4248-98e9-d695f819d148 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:56.073973 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-61a63d4d-e6e8-4248-98e9-d695f819d148 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:56.106023 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-61a63d4d-e6e8-4248-98e9-d695f819d148 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046117 Apr 12 00:41:56.106746 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 599/1223] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:41:56 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:41:57.118186 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-561dd495-057c-4b2f-92e0-fbf704333fa1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:57.119255 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-561dd495-057c-4b2f-92e0-fbf704333fa1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:41:57.125321 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-561dd495-057c-4b2f-92e0-fbf704333fa1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:57.125767 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-561dd495-057c-4b2f-92e0-fbf704333fa1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:57.126547 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-561dd495-057c-4b2f-92e0-fbf704333fa1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:57.126977 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-561dd495-057c-4b2f-92e0-fbf704333fa1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:57.154467 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-561dd495-057c-4b2f-92e0-fbf704333fa1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041454 Apr 12 00:41:57.155008 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 625/1224] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:41:57 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:41:57.209832 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-7bf28cad-90bf-4f39-bf08-79fa3281fcb6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:57.210445 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-7bf28cad-90bf-4f39-bf08-79fa3281fcb6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:41:57.216538 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7bf28cad-90bf-4f39-bf08-79fa3281fcb6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:57.216984 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7bf28cad-90bf-4f39-bf08-79fa3281fcb6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:57.217772 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7bf28cad-90bf-4f39-bf08-79fa3281fcb6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:57.218205 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-7bf28cad-90bf-4f39-bf08-79fa3281fcb6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:57.241174 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-7bf28cad-90bf-4f39-bf08-79fa3281fcb6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Going to try to terminate instance {{(pid=128487) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:41:57.314000 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-7bf28cad-90bf-4f39-bf08-79fa3281fcb6 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 204 len: 0 microversion: 2.1 time: 0.107538 Apr 12 00:41:57.314614 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 600/1225] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:41:57 2022] DELETE /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:41:57.323035 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-de474417-b979-46f2-840d-e6d9eccea703 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:57.323801 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-de474417-b979-46f2-840d-e6d9eccea703 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:41:57.329786 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-de474417-b979-46f2-840d-e6d9eccea703 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:57.330232 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-de474417-b979-46f2-840d-e6d9eccea703 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:57.331019 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-de474417-b979-46f2-840d-e6d9eccea703 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:57.331446 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-de474417-b979-46f2-840d-e6d9eccea703 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:57.456861 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-de474417-b979-46f2-840d-e6d9eccea703 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:41:57.464005 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-de474417-b979-46f2-840d-e6d9eccea703 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1682 microversion: 2.1 time: 0.144916 Apr 12 00:41:57.464556 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 626/1226] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:41:57 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1682 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:41:58.483137 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d5f89a14-2bb1-4b32-a1dc-9c827bb297de tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:58.483836 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d5f89a14-2bb1-4b32-a1dc-9c827bb297de tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:41:58.490033 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d5f89a14-2bb1-4b32-a1dc-9c827bb297de tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:58.490510 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d5f89a14-2bb1-4b32-a1dc-9c827bb297de tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:58.491272 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d5f89a14-2bb1-4b32-a1dc-9c827bb297de tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:58.491702 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d5f89a14-2bb1-4b32-a1dc-9c827bb297de tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:58.624300 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-d5f89a14-2bb1-4b32-a1dc-9c827bb297de tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:41:58.631867 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d5f89a14-2bb1-4b32-a1dc-9c827bb297de tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1682 microversion: 2.1 time: 0.153315 Apr 12 00:41:58.632445 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 601/1227] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:41:58 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:41:59.649573 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f69fb9c2-d471-4ab3-b047-1b344ccdced7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:59.650178 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-f69fb9c2-d471-4ab3-b047-1b344ccdced7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:41:59.656572 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f69fb9c2-d471-4ab3-b047-1b344ccdced7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:59.657013 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f69fb9c2-d471-4ab3-b047-1b344ccdced7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:59.657773 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f69fb9c2-d471-4ab3-b047-1b344ccdced7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:41:59.658206 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-f69fb9c2-d471-4ab3-b047-1b344ccdced7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:41:59.790029 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-f69fb9c2-d471-4ab3-b047-1b344ccdced7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:41:59.800375 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f69fb9c2-d471-4ab3-b047-1b344ccdced7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 200 len: 1682 microversion: 2.1 time: 0.155146 Apr 12 00:41:59.803185 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 627/1228] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:41:59 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:00.073212 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-0f6cc544-932d-46e9-ba68-cc67b485f0e3 req-3ab9f78b-a14a-474a-9c1d-8705f13f8205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab1db03-6d57-4cc4-8f8d-8f3d89295019", "name": "network-vif-deleted", "tag": "3a13265b-2931-4702-abb1-4e7e0743d747"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:00.081791 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-0f6cc544-932d-46e9-ba68-cc67b485f0e3 req-3ab9f78b-a14a-474a-9c1d-8705f13f8205 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:00.082348 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-0f6cc544-932d-46e9-ba68-cc67b485f0e3 req-3ab9f78b-a14a-474a-9c1d-8705f13f8205 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:00.096286 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-0f6cc544-932d-46e9-ba68-cc67b485f0e3 req-3ab9f78b-a14a-474a-9c1d-8705f13f8205 service nova] Creating event network-vif-deleted:3a13265b-2931-4702-abb1-4e7e0743d747 for instance 1ab1db03-6d57-4cc4-8f8d-8f3d89295019 on hv-cinder-83625 Apr 12 00:42:00.101997 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-0f6cc544-932d-46e9-ba68-cc67b485f0e3 req-3ab9f78b-a14a-474a-9c1d-8705f13f8205 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033936 Apr 12 00:42:00.103210 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 602/1229] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:00.817762 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9de713d4-7264-4863-9bd1-e18cadefe278 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:00.818388 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9de713d4-7264-4863-9bd1-e18cadefe278 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:42:00.824863 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9de713d4-7264-4863-9bd1-e18cadefe278 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:00.825325 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9de713d4-7264-4863-9bd1-e18cadefe278 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:00.826104 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9de713d4-7264-4863-9bd1-e18cadefe278 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:00.826562 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9de713d4-7264-4863-9bd1-e18cadefe278 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:00.841807 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-9de713d4-7264-4863-9bd1-e18cadefe278 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] HTTP exception thrown: Instance 1ab1db03-6d57-4cc4-8f8d-8f3d89295019 could not be found. Apr 12 00:42:00.842424 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9de713d4-7264-4863-9bd1-e18cadefe278 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Returning 404 to user: Instance 1ab1db03-6d57-4cc4-8f8d-8f3d89295019 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:42:00.843252 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9de713d4-7264-4863-9bd1-e18cadefe278 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 404 len: 111 microversion: 2.1 time: 0.029404 Apr 12 00:42:00.844024 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 628/1230] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:42:00 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:42:00.853264 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-a7afa044-8319-45c9-92a0-667ccbcf61af tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '.version_select at 0x7f64e124d310>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:00.870537 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-a7afa044-8319-45c9-92a0-667ccbcf61af tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2133043091" status: 202 len: 0 microversion: 2.1 time: 0.022020 Apr 12 00:42:00.871118 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 603/1231] 10.222.0.32 () {58 vars in 1220 bytes} [Tue Apr 12 00:42:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2133043091 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:42:01.491887 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-f09ad5fd-fdec-4963-9bd4-d2ff95c636ab tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Action: 'create', calling method: .version_select at 0x7f64e62c5c10>, body: {"keypair": {"name": "tempest-keypair-843769767"}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:01.505357 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-f09ad5fd-fdec-4963-9bd4-d2ff95c636ab tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:42:01.509120 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-f09ad5fd-fdec-4963-9bd4-d2ff95c636ab tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for user 69f5eaf4727f4bbf84ce10a5e07d582e and project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:42:01.754548 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-f09ad5fd-fdec-4963-9bd4-d2ff95c636ab tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:42:01.758781 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.quota [None req-f09ad5fd-fdec-4963-9bd4-d2ff95c636ab tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for user 69f5eaf4727f4bbf84ce10a5e07d582e and project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'key_pairs'} {{(pid=128486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:42:01.771228 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-f09ad5fd-fdec-4963-9bd4-d2ff95c636ab tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.283206 Apr 12 00:42:01.771809 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 629/1232] 10.222.0.32 () {60 vars in 1157 bytes} [Tue Apr 12 00:42:01 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:02.942343 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3b92d733-ea18-4522-a71d-5a3edb2aaeb1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-27069374", "imageRef": "d93af73a-3447-44c5-94c7-26c1edc9f51a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad6fa16c-9ae9-409b-a431-15655dbe3bc7"}], "security_groups": [{"name": "tempest-securitygroup--1998585413"}], "key_name": "tempest-keypair-843769767", "user_data": "}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:03.042047 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.network.neutron [None req-3b92d733-ea18-4522-a71d-5a3edb2aaeb1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] validate_networks() for [('ad6fa16c-9ae9-409b-a431-15655dbe3bc7', None, None, None, None, None)] {{(pid=128487) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 12 00:42:03.391354 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-3b92d733-ea18-4522-a71d-5a3edb2aaeb1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Flavor limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:42:03.391735 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-3b92d733-ea18-4522-a71d-5a3edb2aaeb1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Image limits 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:42:03.392184 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-3b92d733-ea18-4522-a71d-5a3edb2aaeb1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Flavor pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:42:03.392627 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-3b92d733-ea18-4522-a71d-5a3edb2aaeb1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Image pref 0:0:0 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:42:03.393039 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.virt.hardware [None req-3b92d733-ea18-4522-a71d-5a3edb2aaeb1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:42:03.401478 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3b92d733-ea18-4522-a71d-5a3edb2aaeb1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:03.401923 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3b92d733-ea18-4522-a71d-5a3edb2aaeb1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:03.402853 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3b92d733-ea18-4522-a71d-5a3edb2aaeb1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:03.403295 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3b92d733-ea18-4522-a71d-5a3edb2aaeb1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:03.419592 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-3b92d733-ea18-4522-a71d-5a3edb2aaeb1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:42:03.423576 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.quota [None req-3b92d733-ea18-4522-a71d-5a3edb2aaeb1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Getting quotas for user 69f5eaf4727f4bbf84ce10a5e07d582e and project add150d29f3d4ccc8d4e3775577e3d57. Resources: {'cores', 'instances', 'ram'} {{(pid=128487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:42:03.434716 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3b92d733-ea18-4522-a71d-5a3edb2aaeb1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Going to run 1 instances... {{(pid=128487) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 12 00:42:03.437048 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3b92d733-ea18-4522-a71d-5a3edb2aaeb1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d93af73a-3447-44c5-94c7-26c1edc9f51a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 12 00:42:03.483002 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3b92d733-ea18-4522-a71d-5a3edb2aaeb1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.544799 Apr 12 00:42:03.483668 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 604/1233] 10.222.0.32 () {60 vars in 1146 bytes} [Tue Apr 12 00:42:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:42:03.494207 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-03dff236-9a89-4dc6-9db7-f15395b89e51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:03.494841 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-03dff236-9a89-4dc6-9db7-f15395b89e51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:42:03.547190 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-03dff236-9a89-4dc6-9db7-f15395b89e51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:42:03.554402 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-03dff236-9a89-4dc6-9db7-f15395b89e51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 200 len: 1239 microversion: 2.1 time: 0.064635 Apr 12 00:42:03.555621 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 630/1234] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:42:03 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 1239 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:04.572258 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9b41ba56-0453-4e26-bf1d-32b1c561ebae tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:04.572862 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-9b41ba56-0453-4e26-bf1d-32b1c561ebae tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:42:04.579905 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9b41ba56-0453-4e26-bf1d-32b1c561ebae tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:04.580345 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9b41ba56-0453-4e26-bf1d-32b1c561ebae tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:04.581105 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9b41ba56-0453-4e26-bf1d-32b1c561ebae tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:04.581530 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-9b41ba56-0453-4e26-bf1d-32b1c561ebae tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:04.641039 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-9b41ba56-0453-4e26-bf1d-32b1c561ebae tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:42:04.648223 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9b41ba56-0453-4e26-bf1d-32b1c561ebae tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 200 len: 1297 microversion: 2.1 time: 0.080452 Apr 12 00:42:04.648813 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 605/1235] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:42:04 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 1297 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:05.665710 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9983fe67-a1dc-495e-9019-14642167cd0b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:05.666386 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9983fe67-a1dc-495e-9019-14642167cd0b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:42:05.676612 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9983fe67-a1dc-495e-9019-14642167cd0b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:05.677337 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9983fe67-a1dc-495e-9019-14642167cd0b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:05.678324 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9983fe67-a1dc-495e-9019-14642167cd0b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:05.678919 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9983fe67-a1dc-495e-9019-14642167cd0b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:05.819391 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9983fe67-a1dc-495e-9019-14642167cd0b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:42:05.830644 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-b8f1d821-cbaf-49ec-abe6-32edb1fde31e req-88072f22-1e8b-4e51-8d32-90e6f706d328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5858f9b8-f825-4af1-9ee5-9a3effa64514", "tag": "8d060852-cc1b-419f-b360-abd5aab45f8e"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:05.844879 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9983fe67-a1dc-495e-9019-14642167cd0b tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 200 len: 1365 microversion: 2.1 time: 0.180599 Apr 12 00:42:05.845656 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 631/1236] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:42:05 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:05.846697 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-b8f1d821-cbaf-49ec-abe6-32edb1fde31e req-88072f22-1e8b-4e51-8d32-90e6f706d328 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:05.847294 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-b8f1d821-cbaf-49ec-abe6-32edb1fde31e req-88072f22-1e8b-4e51-8d32-90e6f706d328 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:05.862244 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-b8f1d821-cbaf-49ec-abe6-32edb1fde31e req-88072f22-1e8b-4e51-8d32-90e6f706d328 service nova] Creating event network-changed:8d060852-cc1b-419f-b360-abd5aab45f8e for instance 5858f9b8-f825-4af1-9ee5-9a3effa64514 on hv-cinder-83625 Apr 12 00:42:05.868393 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-b8f1d821-cbaf-49ec-abe6-32edb1fde31e req-88072f22-1e8b-4e51-8d32-90e6f706d328 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042057 Apr 12 00:42:05.868990 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 606/1237] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:42:06.862284 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9aaa4cf1-590a-4363-848d-a5b4bd12cc2c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:06.862898 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-9aaa4cf1-590a-4363-848d-a5b4bd12cc2c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:42:06.869630 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9aaa4cf1-590a-4363-848d-a5b4bd12cc2c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:06.870069 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9aaa4cf1-590a-4363-848d-a5b4bd12cc2c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:06.870850 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9aaa4cf1-590a-4363-848d-a5b4bd12cc2c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:06.871278 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-9aaa4cf1-590a-4363-848d-a5b4bd12cc2c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:06.993239 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-9aaa4cf1-590a-4363-848d-a5b4bd12cc2c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:42:07.000325 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9aaa4cf1-590a-4363-848d-a5b4bd12cc2c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 200 len: 1365 microversion: 2.1 time: 0.141844 Apr 12 00:42:07.000884 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 632/1238] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:42:06 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 1365 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:08.018178 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-30002340-b652-4e44-b5a5-13bc744b6c51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:08.018905 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-30002340-b652-4e44-b5a5-13bc744b6c51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:42:08.025984 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-30002340-b652-4e44-b5a5-13bc744b6c51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:08.026460 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-30002340-b652-4e44-b5a5-13bc744b6c51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:08.027209 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-30002340-b652-4e44-b5a5-13bc744b6c51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:08.027636 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-30002340-b652-4e44-b5a5-13bc744b6c51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:08.198633 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-30002340-b652-4e44-b5a5-13bc744b6c51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:42:08.205795 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-30002340-b652-4e44-b5a5-13bc744b6c51 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 200 len: 1365 microversion: 2.1 time: 0.192020 Apr 12 00:42:08.206395 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 607/1239] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:42:08 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:09.222587 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-e7286fe7-473e-4a58-9112-df6505008544 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:09.223194 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-e7286fe7-473e-4a58-9112-df6505008544 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:42:09.229423 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e7286fe7-473e-4a58-9112-df6505008544 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:09.229866 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e7286fe7-473e-4a58-9112-df6505008544 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:09.230692 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e7286fe7-473e-4a58-9112-df6505008544 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:09.231126 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-e7286fe7-473e-4a58-9112-df6505008544 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:09.360488 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-e7286fe7-473e-4a58-9112-df6505008544 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:42:09.367775 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e7286fe7-473e-4a58-9112-df6505008544 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 200 len: 1365 microversion: 2.1 time: 0.149126 Apr 12 00:42:09.368567 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 633/1240] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:42:09 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:10.384467 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b2656633-cbe5-4191-8575-e20d57126433 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:10.385077 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b2656633-cbe5-4191-8575-e20d57126433 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:42:10.391568 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b2656633-cbe5-4191-8575-e20d57126433 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:10.392016 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b2656633-cbe5-4191-8575-e20d57126433 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:10.392771 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b2656633-cbe5-4191-8575-e20d57126433 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:10.393204 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b2656633-cbe5-4191-8575-e20d57126433 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:10.519811 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-b2656633-cbe5-4191-8575-e20d57126433 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:42:10.527586 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b2656633-cbe5-4191-8575-e20d57126433 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 200 len: 1365 microversion: 2.1 time: 0.147011 Apr 12 00:42:10.528148 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 608/1241] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:42:10 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:11.389552 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [req-fe738043-1a87-4c4f-9182-36d0b225f1fb req-9e7af6b0-bcc4-4dad-804e-63246d43104f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5858f9b8-f825-4af1-9ee5-9a3effa64514", "name": "network-vif-plugged", "status": "completed", "tag": "8d060852-cc1b-419f-b360-abd5aab45f8e"}]} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:11.398762 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-fe738043-1a87-4c4f-9182-36d0b225f1fb req-9e7af6b0-bcc4-4dad-804e-63246d43104f service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:11.399206 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [req-fe738043-1a87-4c4f-9182-36d0b225f1fb req-9e7af6b0-bcc4-4dad-804e-63246d43104f service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:11.409497 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.compute.server_external_events [req-fe738043-1a87-4c4f-9182-36d0b225f1fb req-9e7af6b0-bcc4-4dad-804e-63246d43104f service nova] Creating event network-vif-plugged:8d060852-cc1b-419f-b360-abd5aab45f8e for instance 5858f9b8-f825-4af1-9ee5-9a3effa64514 on hv-cinder-83625 Apr 12 00:42:11.414613 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [req-fe738043-1a87-4c4f-9182-36d0b225f1fb req-9e7af6b0-bcc4-4dad-804e-63246d43104f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085800 Apr 12 00:42:11.415243 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 634/1242] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:11.545017 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-e8f50a8f-fd84-4634-abe0-b5d94a9fc113 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:11.545617 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-e8f50a8f-fd84-4634-abe0-b5d94a9fc113 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:42:11.551949 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e8f50a8f-fd84-4634-abe0-b5d94a9fc113 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:11.552396 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e8f50a8f-fd84-4634-abe0-b5d94a9fc113 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:11.553151 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e8f50a8f-fd84-4634-abe0-b5d94a9fc113 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:11.553584 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-e8f50a8f-fd84-4634-abe0-b5d94a9fc113 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:11.727179 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-e8f50a8f-fd84-4634-abe0-b5d94a9fc113 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:42:11.734340 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-e8f50a8f-fd84-4634-abe0-b5d94a9fc113 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 200 len: 1365 microversion: 2.1 time: 0.193213 Apr 12 00:42:11.734910 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 609/1243] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:42:11 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:12.751639 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-14740ccb-b026-4e42-9363-a51b0f4d2d75 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:12.752340 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-14740ccb-b026-4e42-9363-a51b0f4d2d75 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:42:12.759347 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-14740ccb-b026-4e42-9363-a51b0f4d2d75 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:12.759790 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-14740ccb-b026-4e42-9363-a51b0f4d2d75 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:12.760541 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-14740ccb-b026-4e42-9363-a51b0f4d2d75 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:12.760971 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-14740ccb-b026-4e42-9363-a51b0f4d2d75 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:12.891120 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-14740ccb-b026-4e42-9363-a51b0f4d2d75 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:42:12.898265 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-14740ccb-b026-4e42-9363-a51b0f4d2d75 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 200 len: 1365 microversion: 2.1 time: 0.150783 Apr 12 00:42:12.898840 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 635/1244] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:42:12 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:13.915179 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-77065c3f-56aa-48ee-99ed-43e4cddbbc66 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:13.915818 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-77065c3f-56aa-48ee-99ed-43e4cddbbc66 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:42:13.922138 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-77065c3f-56aa-48ee-99ed-43e4cddbbc66 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:13.922539 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-77065c3f-56aa-48ee-99ed-43e4cddbbc66 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:13.923299 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-77065c3f-56aa-48ee-99ed-43e4cddbbc66 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:13.923734 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-77065c3f-56aa-48ee-99ed-43e4cddbbc66 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:14.051325 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-77065c3f-56aa-48ee-99ed-43e4cddbbc66 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:42:14.058626 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-77065c3f-56aa-48ee-99ed-43e4cddbbc66 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 200 len: 1556 microversion: 2.1 time: 0.147407 Apr 12 00:42:14.059182 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 610/1245] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:42:13 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 1556 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:14.074946 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3b44e0dd-c706-4b73-9fd3-10324ad0a21a tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:14.075534 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3b44e0dd-c706-4b73-9fd3-10324ad0a21a tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:42:14.081534 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3b44e0dd-c706-4b73-9fd3-10324ad0a21a tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:14.081998 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3b44e0dd-c706-4b73-9fd3-10324ad0a21a tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:14.082778 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3b44e0dd-c706-4b73-9fd3-10324ad0a21a tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:14.083209 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3b44e0dd-c706-4b73-9fd3-10324ad0a21a tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:14.157173 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3b44e0dd-c706-4b73-9fd3-10324ad0a21a tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.085989 Apr 12 00:42:14.157758 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 636/1246] 10.222.0.32 () {58 vars in 1274 bytes} [Tue Apr 12 00:42:14 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:15.370864 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-b38866e1-3f9c-4b8c-b05c-62f2ecdb8ede req-2f820ede-fd83-4c09-84ff-633b7e2b409c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5858f9b8-f825-4af1-9ee5-9a3effa64514", "tag": "8d060852-cc1b-419f-b360-abd5aab45f8e"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:15.378528 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-b38866e1-3f9c-4b8c-b05c-62f2ecdb8ede req-2f820ede-fd83-4c09-84ff-633b7e2b409c service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:42:15.378972 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-b38866e1-3f9c-4b8c-b05c-62f2ecdb8ede req-2f820ede-fd83-4c09-84ff-633b7e2b409c service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:42:15.389615 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-b38866e1-3f9c-4b8c-b05c-62f2ecdb8ede req-2f820ede-fd83-4c09-84ff-633b7e2b409c service nova] Creating event network-changed:8d060852-cc1b-419f-b360-abd5aab45f8e for instance 5858f9b8-f825-4af1-9ee5-9a3effa64514 on hv-cinder-83625 Apr 12 00:42:15.394620 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-b38866e1-3f9c-4b8c-b05c-62f2ecdb8ede req-2f820ede-fd83-4c09-84ff-633b7e2b409c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084946 Apr 12 00:42:15.395428 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 611/1247] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:26.478265 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:42:26.478812 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: Tue Apr 12 00:42:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 00:43:28.387362 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-ef3b0459-7930-42b8-be55-6f95e9a4dbd7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:28.388298 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-ef3b0459-7930-42b8-be55-6f95e9a4dbd7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:28.393967 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ef3b0459-7930-42b8-be55-6f95e9a4dbd7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:28.394448 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ef3b0459-7930-42b8-be55-6f95e9a4dbd7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:28.395194 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ef3b0459-7930-42b8-be55-6f95e9a4dbd7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:28.395621 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-ef3b0459-7930-42b8-be55-6f95e9a4dbd7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:28.419686 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-ef3b0459-7930-42b8-be55-6f95e9a4dbd7 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514/ips" status: 200 len: 150 microversion: 2.1 time: 0.037484 Apr 12 00:43:28.420234 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 637/1248] 10.222.0.32 () {58 vars in 1247 bytes} [Tue Apr 12 00:43:28 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:43:29.716471 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-293f7af0-aea8-4888-9139-138693f5d736 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "900b951d-1513-4b4e-8a05-f663b7a3749f"}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:43:29.717602 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-293f7af0-aea8-4888-9139-138693f5d736 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:29.723589 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-293f7af0-aea8-4888-9139-138693f5d736 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:29.724034 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-293f7af0-aea8-4888-9139-138693f5d736 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:29.725364 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-293f7af0-aea8-4888-9139-138693f5d736 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:29.726070 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-293f7af0-aea8-4888-9139-138693f5d736 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:29.967349 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-293f7af0-aea8-4888-9139-138693f5d736 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "POST /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256214 Apr 12 00:43:29.967955 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 612/1249] 10.222.0.32 () {60 vars in 1322 bytes} [Tue Apr 12 00:43:29 2022] POST /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:43:37.525282 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8dbdf2ce-dffb-4bba-abf9-2d65974fd122 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:37.525810 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8dbdf2ce-dffb-4bba-abf9-2d65974fd122 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:37.531995 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8dbdf2ce-dffb-4bba-abf9-2d65974fd122 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:37.532437 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8dbdf2ce-dffb-4bba-abf9-2d65974fd122 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:37.533187 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8dbdf2ce-dffb-4bba-abf9-2d65974fd122 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:37.533616 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8dbdf2ce-dffb-4bba-abf9-2d65974fd122 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:37.609357 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.objects.instance [None req-8dbdf2ce-dffb-4bba-abf9-2d65974fd122 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lazy-loading 'services' on Instance uuid 5858f9b8-f825-4af1-9ee5-9a3effa64514 {{(pid=128486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 12 00:43:37.677638 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8dbdf2ce-dffb-4bba-abf9-2d65974fd122 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514/os-volume_attachments/900b951d-1513-4b4e-8a05-f663b7a3749f" status: 202 len: 0 microversion: 2.1 time: 0.156180 Apr 12 00:43:37.678294 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 638/1250] 10.222.0.32 () {58 vars in 1415 bytes} [Tue Apr 12 00:43:37 2022] DELETE /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514/os-volume_attachments/900b951d-1513-4b4e-8a05-f663b7a3749f => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:43:37.687518 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-585a59ea-05a2-4409-b621-2bb6edaec036 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:37.688730 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-585a59ea-05a2-4409-b621-2bb6edaec036 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:37.696026 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-585a59ea-05a2-4409-b621-2bb6edaec036 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:37.696570 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-585a59ea-05a2-4409-b621-2bb6edaec036 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:37.697419 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-585a59ea-05a2-4409-b621-2bb6edaec036 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:37.697947 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-585a59ea-05a2-4409-b621-2bb6edaec036 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:37.729355 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-585a59ea-05a2-4409-b621-2bb6edaec036 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046584 Apr 12 00:43:37.733316 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 613/1251] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:43:37 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:43:38.742046 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-4f47ef34-2773-4984-9667-a29a950de3b2 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:38.743143 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-4f47ef34-2773-4984-9667-a29a950de3b2 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:38.749269 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4f47ef34-2773-4984-9667-a29a950de3b2 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:38.749718 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4f47ef34-2773-4984-9667-a29a950de3b2 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:38.750507 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4f47ef34-2773-4984-9667-a29a950de3b2 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:38.750951 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-4f47ef34-2773-4984-9667-a29a950de3b2 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:38.779360 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-4f47ef34-2773-4984-9667-a29a950de3b2 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042092 Apr 12 00:43:38.779914 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 639/1252] 10.222.0.32 () {58 vars in 1301 bytes} [Tue Apr 12 00:43:38 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:43:38.835498 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-3489c889-b67f-48a7-b53d-c530baa561ee tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:38.835980 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3489c889-b67f-48a7-b53d-c530baa561ee tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:38.842124 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3489c889-b67f-48a7-b53d-c530baa561ee tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:38.842599 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3489c889-b67f-48a7-b53d-c530baa561ee tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:38.843346 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3489c889-b67f-48a7-b53d-c530baa561ee tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:38.843774 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-3489c889-b67f-48a7-b53d-c530baa561ee tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:38.867880 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-3489c889-b67f-48a7-b53d-c530baa561ee tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Going to try to terminate instance {{(pid=128487) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 12 00:43:38.939659 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-3489c889-b67f-48a7-b53d-c530baa561ee tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 204 len: 0 microversion: 2.1 time: 0.108227 Apr 12 00:43:38.940348 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 614/1253] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:43:38 2022] DELETE /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:43:38.949219 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-3b79e19f-f4fd-477c-886f-1d63cef963a5 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:38.949835 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-3b79e19f-f4fd-477c-886f-1d63cef963a5 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:38.955685 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3b79e19f-f4fd-477c-886f-1d63cef963a5 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:38.956138 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3b79e19f-f4fd-477c-886f-1d63cef963a5 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:38.956900 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3b79e19f-f4fd-477c-886f-1d63cef963a5 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:38.957341 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-3b79e19f-f4fd-477c-886f-1d63cef963a5 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:39.086566 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-3b79e19f-f4fd-477c-886f-1d63cef963a5 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:43:39.093813 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-3b79e19f-f4fd-477c-886f-1d63cef963a5 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 200 len: 1680 microversion: 2.1 time: 0.148517 Apr 12 00:43:39.094404 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 640/1254] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:43:38 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:43:40.112165 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-f663ab19-e032-4d6a-90b6-2c9ca05c959c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:40.112864 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-f663ab19-e032-4d6a-90b6-2c9ca05c959c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:40.119720 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f663ab19-e032-4d6a-90b6-2c9ca05c959c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:40.120165 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f663ab19-e032-4d6a-90b6-2c9ca05c959c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:40.120930 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f663ab19-e032-4d6a-90b6-2c9ca05c959c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:40.121363 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-f663ab19-e032-4d6a-90b6-2c9ca05c959c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:40.247600 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.policy [None req-f663ab19-e032-4d6a-90b6-2c9ca05c959c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128487) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:43:40.254882 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-f663ab19-e032-4d6a-90b6-2c9ca05c959c tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 200 len: 1680 microversion: 2.1 time: 0.146983 Apr 12 00:43:40.255513 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 615/1255] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:43:40 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:43:41.272956 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-74f4fd38-f853-4b81-a13f-952b885cd7d2 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:41.273693 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-74f4fd38-f853-4b81-a13f-952b885cd7d2 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:41.279945 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-74f4fd38-f853-4b81-a13f-952b885cd7d2 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:41.280399 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-74f4fd38-f853-4b81-a13f-952b885cd7d2 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:41.281166 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-74f4fd38-f853-4b81-a13f-952b885cd7d2 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:41.281608 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-74f4fd38-f853-4b81-a13f-952b885cd7d2 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:41.406083 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.policy [None req-74f4fd38-f853-4b81-a13f-952b885cd7d2 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f5eaf4727f4bbf84ce10a5e07d582e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add150d29f3d4ccc8d4e3775577e3d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128486) authorize /opt/stack/nova/nova/policy.py:199}} Apr 12 00:43:41.413531 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-74f4fd38-f853-4b81-a13f-952b885cd7d2 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 200 len: 1680 microversion: 2.1 time: 0.145064 Apr 12 00:43:41.414095 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 641/1256] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:43:41 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 1680 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:43:41.844831 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [req-7d54e358-30be-4969-8fc8-854e6022dcee req-7ff6521e-9a44-4ca8-83a0-be02b084b085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5858f9b8-f825-4af1-9ee5-9a3effa64514", "name": "network-vif-deleted", "tag": "8d060852-cc1b-419f-b360-abd5aab45f8e"}]} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:43:41.856380 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-7d54e358-30be-4969-8fc8-854e6022dcee req-7ff6521e-9a44-4ca8-83a0-be02b084b085 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:41.861740 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [req-7d54e358-30be-4969-8fc8-854e6022dcee req-7ff6521e-9a44-4ca8-83a0-be02b084b085 service nova] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:41.873997 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.compute.server_external_events [req-7d54e358-30be-4969-8fc8-854e6022dcee req-7ff6521e-9a44-4ca8-83a0-be02b084b085 service nova] Creating event network-vif-deleted:8d060852-cc1b-419f-b360-abd5aab45f8e for instance 5858f9b8-f825-4af1-9ee5-9a3effa64514 on hv-cinder-83625 Apr 12 00:43:41.879180 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [req-7d54e358-30be-4969-8fc8-854e6022dcee req-7ff6521e-9a44-4ca8-83a0-be02b084b085 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099711 Apr 12 00:43:41.880212 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 616/1257] 10.222.0.32 () {64 vars in 1317 bytes} [Tue Apr 12 00:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:43:42.430754 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-16fba67e-85cd-4e7d-9c4a-4aa332cf68e1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:42.431424 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-16fba67e-85cd-4e7d-9c4a-4aa332cf68e1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:42.437989 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-16fba67e-85cd-4e7d-9c4a-4aa332cf68e1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:42.438481 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-16fba67e-85cd-4e7d-9c4a-4aa332cf68e1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:42.439250 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-16fba67e-85cd-4e7d-9c4a-4aa332cf68e1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:42.439690 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-16fba67e-85cd-4e7d-9c4a-4aa332cf68e1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:42.452917 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-16fba67e-85cd-4e7d-9c4a-4aa332cf68e1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] HTTP exception thrown: Instance 5858f9b8-f825-4af1-9ee5-9a3effa64514 could not be found. Apr 12 00:43:42.453548 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-16fba67e-85cd-4e7d-9c4a-4aa332cf68e1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Returning 404 to user: Instance 5858f9b8-f825-4af1-9ee5-9a3effa64514 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:43:42.454445 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-16fba67e-85cd-4e7d-9c4a-4aa332cf68e1 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 404 len: 111 microversion: 2.1 time: 0.028384 Apr 12 00:43:42.454994 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 642/1258] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:43:42 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:43:42.463911 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-9b5b66c8-1c18-4ae2-9346-a0fd65d2e383 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '.version_select at 0x7f64e109ad30>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:42.481705 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-9b5b66c8-1c18-4ae2-9346-a0fd65d2e383 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-843769767" status: 202 len: 0 microversion: 2.1 time: 0.021950 Apr 12 00:43:42.482329 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 617/1259] 10.222.0.32 () {58 vars in 1217 bytes} [Tue Apr 12 00:43:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-843769767 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 00:43:44.236661 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8cd65955-9afc-4fae-bd10-3dd716e03746 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:44.237162 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-8cd65955-9afc-4fae-bd10-3dd716e03746 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:44.243340 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8cd65955-9afc-4fae-bd10-3dd716e03746 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:44.243788 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8cd65955-9afc-4fae-bd10-3dd716e03746 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:44.244551 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8cd65955-9afc-4fae-bd10-3dd716e03746 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:44.244987 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-8cd65955-9afc-4fae-bd10-3dd716e03746 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:44.257730 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-8cd65955-9afc-4fae-bd10-3dd716e03746 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] HTTP exception thrown: Instance 5858f9b8-f825-4af1-9ee5-9a3effa64514 could not be found. Apr 12 00:43:44.258325 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-8cd65955-9afc-4fae-bd10-3dd716e03746 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Returning 404 to user: Instance 5858f9b8-f825-4af1-9ee5-9a3effa64514 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:43:44.259118 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-8cd65955-9afc-4fae-bd10-3dd716e03746 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 404 len: 111 microversion: 2.1 time: 0.026516 Apr 12 00:43:44.259623 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 643/1260] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:43:44 2022] DELETE /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:43:44.267673 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-cb07938f-80d6-41e7-9d37-2c24e7d42680 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:44.268387 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-cb07938f-80d6-41e7-9d37-2c24e7d42680 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 5858f9b8-f825-4af1-9ee5-9a3effa64514] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:44.275364 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cb07938f-80d6-41e7-9d37-2c24e7d42680 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:44.275816 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cb07938f-80d6-41e7-9d37-2c24e7d42680 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:44.276573 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cb07938f-80d6-41e7-9d37-2c24e7d42680 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:44.277009 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-cb07938f-80d6-41e7-9d37-2c24e7d42680 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:44.290526 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-cb07938f-80d6-41e7-9d37-2c24e7d42680 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] HTTP exception thrown: Instance 5858f9b8-f825-4af1-9ee5-9a3effa64514 could not be found. Apr 12 00:43:44.291103 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-cb07938f-80d6-41e7-9d37-2c24e7d42680 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Returning 404 to user: Instance 5858f9b8-f825-4af1-9ee5-9a3effa64514 could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:43:44.291913 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-cb07938f-80d6-41e7-9d37-2c24e7d42680 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514" status: 404 len: 111 microversion: 2.1 time: 0.028108 Apr 12 00:43:44.292434 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 618/1261] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:43:44 2022] GET /compute/v2.1/servers/5858f9b8-f825-4af1-9ee5-9a3effa64514 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:43:45.418462 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-284cddc2-6927-4379-b025-6857cb70a075 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:45.418952 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-284cddc2-6927-4379-b025-6857cb70a075 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:45.425204 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-284cddc2-6927-4379-b025-6857cb70a075 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:45.425650 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-284cddc2-6927-4379-b025-6857cb70a075 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:45.426438 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-284cddc2-6927-4379-b025-6857cb70a075 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:45.426868 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-284cddc2-6927-4379-b025-6857cb70a075 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:45.439677 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-284cddc2-6927-4379-b025-6857cb70a075 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] HTTP exception thrown: Instance 1ab1db03-6d57-4cc4-8f8d-8f3d89295019 could not be found. Apr 12 00:43:45.440239 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-284cddc2-6927-4379-b025-6857cb70a075 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Returning 404 to user: Instance 1ab1db03-6d57-4cc4-8f8d-8f3d89295019 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:43:45.441033 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-284cddc2-6927-4379-b025-6857cb70a075 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 404 len: 111 microversion: 2.1 time: 0.026522 Apr 12 00:43:45.441551 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 644/1262] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:43:45 2022] DELETE /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:43:45.449712 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-dc7712fa-5304-4b54-ba3a-171e72c192ab tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:45.450349 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-dc7712fa-5304-4b54-ba3a-171e72c192ab tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 1ab1db03-6d57-4cc4-8f8d-8f3d89295019] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:45.456527 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dc7712fa-5304-4b54-ba3a-171e72c192ab tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:45.456968 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dc7712fa-5304-4b54-ba3a-171e72c192ab tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:45.457713 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dc7712fa-5304-4b54-ba3a-171e72c192ab tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:45.458142 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-dc7712fa-5304-4b54-ba3a-171e72c192ab tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:45.473161 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-dc7712fa-5304-4b54-ba3a-171e72c192ab tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] HTTP exception thrown: Instance 1ab1db03-6d57-4cc4-8f8d-8f3d89295019 could not be found. Apr 12 00:43:45.473734 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-dc7712fa-5304-4b54-ba3a-171e72c192ab tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Returning 404 to user: Instance 1ab1db03-6d57-4cc4-8f8d-8f3d89295019 could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:43:45.475060 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-dc7712fa-5304-4b54-ba3a-171e72c192ab tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019" status: 404 len: 111 microversion: 2.1 time: 0.029167 Apr 12 00:43:45.475586 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 619/1263] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:43:45 2022] GET /compute/v2.1/servers/1ab1db03-6d57-4cc4-8f8d-8f3d89295019 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 00:43:45.483762 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0841b961-a429-41c8-84c3-4de47d8797a9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:45.484257 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-0841b961-a429-41c8-84c3-4de47d8797a9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:45.490763 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0841b961-a429-41c8-84c3-4de47d8797a9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:45.491212 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0841b961-a429-41c8-84c3-4de47d8797a9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:45.491968 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0841b961-a429-41c8-84c3-4de47d8797a9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:45.492400 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-0841b961-a429-41c8-84c3-4de47d8797a9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:45.505126 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-0841b961-a429-41c8-84c3-4de47d8797a9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] HTTP exception thrown: Instance 8a589bc8-9b32-4820-aa00-e5c764ba1b77 could not be found. Apr 12 00:43:45.505698 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-0841b961-a429-41c8-84c3-4de47d8797a9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Returning 404 to user: Instance 8a589bc8-9b32-4820-aa00-e5c764ba1b77 could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:43:45.506518 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-0841b961-a429-41c8-84c3-4de47d8797a9 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 404 len: 111 microversion: 2.1 time: 0.026741 Apr 12 00:43:45.507024 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 645/1264] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:43:45 2022] DELETE /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:43:45.514868 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b13e40f4-52d7-4b13-80a1-496c1ca9259f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:45.515478 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-b13e40f4-52d7-4b13-80a1-496c1ca9259f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: 8a589bc8-9b32-4820-aa00-e5c764ba1b77] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:45.521196 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b13e40f4-52d7-4b13-80a1-496c1ca9259f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:45.521651 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b13e40f4-52d7-4b13-80a1-496c1ca9259f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:45.522433 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b13e40f4-52d7-4b13-80a1-496c1ca9259f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:45.522865 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-b13e40f4-52d7-4b13-80a1-496c1ca9259f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:45.535512 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-b13e40f4-52d7-4b13-80a1-496c1ca9259f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] HTTP exception thrown: Instance 8a589bc8-9b32-4820-aa00-e5c764ba1b77 could not be found. Apr 12 00:43:45.536079 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-b13e40f4-52d7-4b13-80a1-496c1ca9259f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Returning 404 to user: Instance 8a589bc8-9b32-4820-aa00-e5c764ba1b77 could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:43:45.537400 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-b13e40f4-52d7-4b13-80a1-496c1ca9259f tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77" status: 404 len: 111 microversion: 2.1 time: 0.026573 Apr 12 00:43:45.537905 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 620/1265] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:43:45 2022] GET /compute/v2.1/servers/8a589bc8-9b32-4820-aa00-e5c764ba1b77 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:43:46.663881 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b135a249-de0a-42b2-aa60-2b3cae9d87cc tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:46.664430 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.compute.api [None req-b135a249-de0a-42b2-aa60-2b3cae9d87cc tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128486) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:46.670639 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b135a249-de0a-42b2-aa60-2b3cae9d87cc tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:46.671088 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b135a249-de0a-42b2-aa60-2b3cae9d87cc tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:46.671846 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b135a249-de0a-42b2-aa60-2b3cae9d87cc tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:46.672280 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG oslo_concurrency.lockutils [None req-b135a249-de0a-42b2-aa60-2b3cae9d87cc tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:46.685116 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-b135a249-de0a-42b2-aa60-2b3cae9d87cc tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] HTTP exception thrown: Instance ca8227d3-6b1f-4d92-90c7-41de2b3054bd could not be found. Apr 12 00:43:46.685719 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-b135a249-de0a-42b2-aa60-2b3cae9d87cc tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Returning 404 to user: Instance ca8227d3-6b1f-4d92-90c7-41de2b3054bd could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:43:46.686554 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-b135a249-de0a-42b2-aa60-2b3cae9d87cc tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 404 len: 111 microversion: 2.1 time: 0.027247 Apr 12 00:43:46.687073 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 646/1266] 10.222.0.32 () {58 vars in 1238 bytes} [Tue Apr 12 00:43:46 2022] DELETE /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:43:46.695049 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d4d5e9f7-57c3-4e8c-9fcd-26fd48787727 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Calling method '>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:46.695662 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.compute.api [None req-d4d5e9f7-57c3-4e8c-9fcd-26fd48787727 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] [instance: ca8227d3-6b1f-4d92-90c7-41de2b3054bd] Fetching instance by UUID {{(pid=128487) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 12 00:43:46.701795 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d4d5e9f7-57c3-4e8c-9fcd-26fd48787727 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:46.702239 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d4d5e9f7-57c3-4e8c-9fcd-26fd48787727 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:46.703032 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d4d5e9f7-57c3-4e8c-9fcd-26fd48787727 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 12 00:43:46.703465 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG oslo_concurrency.lockutils [None req-d4d5e9f7-57c3-4e8c-9fcd-26fd48787727 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Lock "d5ead109-62c7-446f-b4c2-717e64dca700" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 12 00:43:46.716982 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-d4d5e9f7-57c3-4e8c-9fcd-26fd48787727 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] HTTP exception thrown: Instance ca8227d3-6b1f-4d92-90c7-41de2b3054bd could not be found. Apr 12 00:43:46.717554 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-d4d5e9f7-57c3-4e8c-9fcd-26fd48787727 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] Returning 404 to user: Instance ca8227d3-6b1f-4d92-90c7-41de2b3054bd could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:43:46.718390 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-d4d5e9f7-57c3-4e8c-9fcd-26fd48787727 tempest-AttachVolumeNegativeTest-1778238704 tempest-AttachVolumeNegativeTest-1778238704-project] 10.222.0.32 "GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd" status: 404 len: 111 microversion: 2.1 time: 0.027192 Apr 12 00:43:46.718912 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 621/1267] 10.222.0.32 () {58 vars in 1235 bytes} [Tue Apr 12 00:43:46 2022] GET /compute/v2.1/servers/ca8227d3-6b1f-4d92-90c7-41de2b3054bd => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:43:51.067177 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9e756082-7b8c-4bd0-a316-b12477b99e5c tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] Action: 'create', calling method: .version_select at 0x7f64e1483c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1682267023", "metadata": {"Type": "work"}}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:43:51.068614 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-9e756082-7b8c-4bd0-a316-b12477b99e5c tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:43:51.069443 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-9e756082-7b8c-4bd0-a316-b12477b99e5c tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.109729 Apr 12 00:43:51.069955 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 647/1268] 10.222.0.32 () {60 vars in 1155 bytes} [Tue Apr 12 00:43:50 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:43:51.078956 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-146500b7-bac4-4683-84e0-4e1887ea42d9 tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] Action: 'create', calling method: .version_select at 0x7f64e1046af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-705176217", "metadata": {"Type": "work"}}} {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:43:51.080352 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-146500b7-bac4-4683-84e0-4e1887ea42d9 tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:43:51.081129 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-146500b7-bac4-4683-84e0-4e1887ea42d9 tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006146 Apr 12 00:43:51.081634 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 622/1269] 10.222.0.32 () {60 vars in 1155 bytes} [Tue Apr 12 00:43:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:43:51.090293 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2e61c9ed-2691-4f8d-8d02-3ab39bfff467 tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] Action: 'create', calling method: .version_select at 0x7f64e11e05e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-163901619", "metadata": {"Type": "work"}}} {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:43:51.092150 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-2e61c9ed-2691-4f8d-8d02-3ab39bfff467 tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:43:51.092925 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-2e61c9ed-2691-4f8d-8d02-3ab39bfff467 tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006235 Apr 12 00:43:51.093423 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 648/1270] 10.222.0.32 () {60 vars in 1155 bytes} [Tue Apr 12 00:43:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 12 00:43:51.102345 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5c938f89-746b-4491-971f-dfd26d1a7b4e tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] Calling method '.version_select at 0x7f64e1059c10>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:51.128838 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-5c938f89-746b-4491-971f-dfd26d1a7b4e tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] HTTP exception thrown: Volume tempest-invalid-1733128709 could not be found. Apr 12 00:43:51.129406 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-5c938f89-746b-4491-971f-dfd26d1a7b4e tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] Returning 404 to user: Volume tempest-invalid-1733128709 could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:43:51.130223 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-5c938f89-746b-4491-971f-dfd26d1a7b4e tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1733128709" status: 404 len: 99 microversion: 2.1 time: 0.032464 Apr 12 00:43:51.130772 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 623/1271] 10.222.0.32 () {58 vars in 1217 bytes} [Tue Apr 12 00:43:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1733128709 => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 12 00:43:51.139602 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-e5ed6d0b-9a9f-4734-b069-8c8546d03517 tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003880 Apr 12 00:43:51.140095 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 649/1272] 10.222.0.32 () {58 vars in 1139 bytes} [Tue Apr 12 00:43:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 00:43:51.148879 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-72e46465-c9fd-473d-a1b4-b604c36f5606 tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004071 Apr 12 00:43:51.149368 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 624/1273] 10.222.0.32 () {58 vars in 1136 bytes} [Tue Apr 12 00:43:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 00:43:51.157073 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-798dbcf9-f238-4d06-9aa2-7bb08afc149e tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] Calling method '.version_select at 0x7f64e62938b0>' {{(pid=128486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:51.183951 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.wsgi [None req-798dbcf9-f238-4d06-9aa2-7bb08afc149e tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] HTTP exception thrown: Volume cbb72b25-b582-491c-a6b2-36f3dd74180f could not be found. Apr 12 00:43:51.184535 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: DEBUG nova.api.openstack.wsgi [None req-798dbcf9-f238-4d06-9aa2-7bb08afc149e tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] Returning 404 to user: Volume cbb72b25-b582-491c-a6b2-36f3dd74180f could not be found. {{(pid=128486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:43:51.185355 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO nova.api.openstack.requestlog [None req-798dbcf9-f238-4d06-9aa2-7bb08afc149e tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/cbb72b25-b582-491c-a6b2-36f3dd74180f" status: 404 len: 109 microversion: 2.1 time: 0.031735 Apr 12 00:43:51.185888 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: [pid: 128486|app: 0|req: 650/1274] 10.222.0.32 () {58 vars in 1247 bytes} [Tue Apr 12 00:43:51 2022] DELETE /compute/v2.1/os-volumes/cbb72b25-b582-491c-a6b2-36f3dd74180f => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:43:51.194576 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-49a130dd-1934-418b-9a64-5a5db8f12ada tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] Calling method '.version_select at 0x7f64e1046160>' {{(pid=128487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:51.220316 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.wsgi [None req-49a130dd-1934-418b-9a64-5a5db8f12ada tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] HTTP exception thrown: Volume a42a2904-b825-46bd-a7cf-642ff701c311 could not be found. Apr 12 00:43:51.220906 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: DEBUG nova.api.openstack.wsgi [None req-49a130dd-1934-418b-9a64-5a5db8f12ada tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] Returning 404 to user: Volume a42a2904-b825-46bd-a7cf-642ff701c311 could not be found. {{(pid=128487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 12 00:43:51.221712 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO nova.api.openstack.requestlog [None req-49a130dd-1934-418b-9a64-5a5db8f12ada tempest-VolumesNegativeTest-2033469356 tempest-VolumesNegativeTest-2033469356-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/a42a2904-b825-46bd-a7cf-642ff701c311" status: 404 len: 109 microversion: 2.1 time: 0.030885 Apr 12 00:43:51.222233 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: [pid: 128487|app: 0|req: 625/1275] 10.222.0.32 () {58 vars in 1244 bytes} [Tue Apr 12 00:43:51 2022] GET /compute/v2.1/os-volumes/a42a2904-b825-46bd-a7cf-642ff701c311 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:44:24.095940 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:44:24.096624 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: Tue Apr 12 00:44:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 00:45:46.486664 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:45:46.487190 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: Tue Apr 12 00:45:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 00:46:04.249759 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:46:04.250431 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: Tue Apr 12 00:46:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 00:46:09.550421 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:46:09.551039 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: Tue Apr 12 00:46:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 00:47:29.814181 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:47:29.814733 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: Tue Apr 12 00:47:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 00:47:44.104029 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:47:44.104579 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: Tue Apr 12 00:47:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 00:49:01.068249 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:49:01.068968 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: Tue Apr 12 00:49:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 00:49:06.495247 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:49:06.495839 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: Tue Apr 12 00:49:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 00:49:24.261146 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:49:24.261859 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: Tue Apr 12 00:49:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 00:49:29.558507 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:49:29.559095 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: Tue Apr 12 00:49:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 00:50:49.822309 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:50:49.822823 dv-cinder-836252-3-iscsi devstack@n-api.service[128486]: Tue Apr 12 00:50:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 12 00:51:04.112689 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 00:51:04.113165 dv-cinder-836252-3-iscsi devstack@n-api.service[128487]: Tue Apr 12 00:51:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!